[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:26:53 dist-test-slave-77v9 krb5kdc[12263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:26:53 dist-test-slave-77v9 krb5kdc[12263](info): set up 2 sockets
Aug 11 07:26:53 dist-test-slave-77v9 krb5kdc[12263](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 07:26:54.437422 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.007s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:26:54 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:26:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:26:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:26:54.585069 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:33421
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:33421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:54.737962 12278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:54.738363 12278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:54.738466 12278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:54.743637 12278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:26:54.743805 12278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:54.743853 12278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:54.744002 12278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:26:54.744051 12278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:26:54.750967 12278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:33421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:33421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:54.752372 12278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:54.753657 12278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:54.764235 12285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:54.764328 12288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:54.764360 12284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:54.764583 12278 server_base.cc:1034] running on GCE node
I20260811 07:26:54.765491 12278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:54.766876 12278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:54.768111 12278 hybrid_clock.cc:648] HybridClock initialized: now 1786433214768062 us; error 66 us; skew 500 ppm
Aug 11 07:26:54 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:54.771883 12278 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:26:54.773113 12278 webserver.cc:460] Webserver started at http://127.11.248.62:42785/ using document root <none> and password file <none>
I20260811 07:26:54.773777 12278 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:54.773883 12278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:54.774169 12278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:54.777088 12278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "3162f6199fd5419f94fec7112f3f11f4"
format_stamp: "Formatted at 2026-08-11 07:26:54 on dist-test-slave-77v9"
server_key: "a192fea460fe5951221e718bc2137c61"
server_key_iv: "8a4e721153038ba3a0eaa6c96e966c77"
server_key_version: "encryptionkey@0"
I20260811 07:26:54.777829 12278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "3162f6199fd5419f94fec7112f3f11f4"
format_stamp: "Formatted at 2026-08-11 07:26:54 on dist-test-slave-77v9"
server_key: "a192fea460fe5951221e718bc2137c61"
server_key_iv: "8a4e721153038ba3a0eaa6c96e966c77"
server_key_version: "encryptionkey@0"
I20260811 07:26:54.783389 12278 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260811 07:26:54.786890 12295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:54.788545 12278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 07:26:54.788766 12278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "3162f6199fd5419f94fec7112f3f11f4"
format_stamp: "Formatted at 2026-08-11 07:26:54 on dist-test-slave-77v9"
server_key: "a192fea460fe5951221e718bc2137c61"
server_key_iv: "8a4e721153038ba3a0eaa6c96e966c77"
server_key_version: "encryptionkey@0"
I20260811 07:26:54.789088 12278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:54.813402 12278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:54.817996 12278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:54.818315 12278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:54.834923 12278 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:33421
I20260811 07:26:54.835027 12353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:33421 every 8 connection(s)
I20260811 07:26:54.836294 12278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:26:54.839974 12354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:26:54.846230 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 12278
I20260811 07:26:54.846428 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:26:54.848610 12256 external_mini_cluster.cc:1428] Setting key 8bb8d48e4ad4737b08345ba1e839564b
I20260811 07:26:54.849030 12354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4: Bootstrap starting.
I20260811 07:26:54.854060 12354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4: Neither blocks nor log segments found. Creating new log.
I20260811 07:26:54.855638 12354 log.cc:824] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4: Log is configured to *not* fsync() on all Append() calls
I20260811 07:26:54.858554 12354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4: No bootstrap required, opened a new log
I20260811 07:26:54.863413 12354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3162f6199fd5419f94fec7112f3f11f4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33421 } }
I20260811 07:26:54.863859 12354 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:26:54.863926 12354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3162f6199fd5419f94fec7112f3f11f4, State: Initialized, Role: FOLLOWER
I20260811 07:26:54.864503 12354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3162f6199fd5419f94fec7112f3f11f4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33421 } }
I20260811 07:26:54.864689 12354 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:26:54.864758 12354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:26:54.864904 12354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:26:54.866135 12354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3162f6199fd5419f94fec7112f3f11f4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33421 } }
I20260811 07:26:54.866555 12354 leader_election.cc:302] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3162f6199fd5419f94fec7112f3f11f4; no voters:
I20260811 07:26:54.867004 12354 leader_election.cc:288] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:26:54.867256 12359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:26:54.867794 12359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [term 1 LEADER]: Becoming Leader. State: Replica: 3162f6199fd5419f94fec7112f3f11f4, State: Running, Role: LEADER
I20260811 07:26:54.868220 12359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3162f6199fd5419f94fec7112f3f11f4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33421 } }
I20260811 07:26:54.868583 12354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:26:54.871027 12360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3162f6199fd5419f94fec7112f3f11f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3162f6199fd5419f94fec7112f3f11f4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33421 } } }
I20260811 07:26:54.871054 12361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3162f6199fd5419f94fec7112f3f11f4. Latest consensus state: current_term: 1 leader_uuid: "3162f6199fd5419f94fec7112f3f11f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3162f6199fd5419f94fec7112f3f11f4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33421 } } }
I20260811 07:26:54.871214 12360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [sys.catalog]: This master's current role is: LEADER
I20260811 07:26:54.871276 12361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4 [sys.catalog]: This master's current role is: LEADER
I20260811 07:26:54.871896 12370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:26:54.875715 12370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 07:26:54 dist-test-slave-77v9 krb5kdc[12263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:26:54.882793 12370 catalog_manager.cc:1347] Generated new cluster ID: 3f912deefcac4c018d251dda363af014
I20260811 07:26:54.882874 12370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:26:54.887966 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:54.853208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52184 (local address 127.11.248.62:33421)
0811 07:26:54.854147 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:54.854216 (+ 69us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:54.855358 (+ 1142us) server_negotiation.cc:407] Connection header received
0811 07:26:54.859850 (+ 4492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:54.859875 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:54.860327 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:54.860757 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:54.863430 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:54.865323 (+ 1893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:54.866921 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:54.867656 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:54.869821 (+ 2165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:54.879807 (+ 9986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:54.879818 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:54.879833 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:54.879881 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:54.883207 (+ 3326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:54.884089 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:54.884095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:54.884101 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:54.884252 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:54.884722 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:54.884726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:54.884727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:54.885278 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:54.885568 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:54.886234 (+ 666us) server_negotiation.cc:299] Negotiation successful
0811 07:26:54.886580 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":173,"threads_started":1}
I20260811 07:26:54.904718 12370 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:26:54.905930 12370 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:26:54.912915 12370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3162f6199fd5419f94fec7112f3f11f4: Generated new TSK 0
I20260811 07:26:54.913938 12370 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:26:54.956641 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33421
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:55.093644 12384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:55.093956 12384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:55.094005 12384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:55.098470 12384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:55.098556 12384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:55.098623 12384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:26:55.104298 12384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33421
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:55.105520 12384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:55.106598 12384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:55.117244 12393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:55.117341 12391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:55.117268 12390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:55.117515 12384 server_base.cc:1034] running on GCE node
I20260811 07:26:55.118014 12384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:55.118752 12384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:55.119962 12384 hybrid_clock.cc:648] HybridClock initialized: now 1786433215119946 us; error 31 us; skew 500 ppm
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:55.123189 12384 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:26:55.124152 12384 webserver.cc:460] Webserver started at http://127.11.248.1:38043/ using document root <none> and password file <none>
I20260811 07:26:55.124763 12384 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:55.124900 12384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:55.125156 12384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:55.127568 12384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "accd1bdb1f0b4b06a88b6c919c7e7585"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "21c0861bd2b80bba16830a167603d371"
server_key_iv: "57cceae40f4af364e74edf298897e3aa"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.128211 12384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "accd1bdb1f0b4b06a88b6c919c7e7585"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "21c0861bd2b80bba16830a167603d371"
server_key_iv: "57cceae40f4af364e74edf298897e3aa"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.132622 12384 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260811 07:26:55.135615 12400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.137326 12384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:26:55.137490 12384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "accd1bdb1f0b4b06a88b6c919c7e7585"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "21c0861bd2b80bba16830a167603d371"
server_key_iv: "57cceae40f4af364e74edf298897e3aa"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.137631 12384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:55.180924 12384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:55.185279 12384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:55.185539 12384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:55.186306 12384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:26:55.187335 12384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:26:55.187414 12384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.187484 12384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:26:55.187531 12384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.203174 12384 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:40135
I20260811 07:26:55.203238 12528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:40135 every 8 connection(s)
I20260811 07:26:55.204227 12384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:26:55.206887 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 12384
I20260811 07:26:55.207005 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:26:55.207358 12256 external_mini_cluster.cc:1428] Setting key 0beaac31f89221903ca9203c5c29f95b
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:26:55.222285 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.206418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:54789 (local address 127.11.248.62:33421)
0811 07:26:55.206611 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:55.206615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:55.208001 (+ 1386us) server_negotiation.cc:407] Connection header received
0811 07:26:55.209751 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:55.209757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:55.209820 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:55.209936 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:55.211399 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.211955 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.213310 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.213570 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.213691 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.217176 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:55.217180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:55.217182 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:55.217213 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:55.219271 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.219955 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.219959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.219960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.220068 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.220539 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.220547 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.220551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.220977 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:55.221086 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:55.221982 (+ 896us) server_negotiation.cc:299] Negotiation successful
0811 07:26:55.222133 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:26:55.223215 12531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.206956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33421 (local address 127.11.248.1:54789)
0811 07:26:55.207772 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:55.207864 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:55.209535 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:55.210092 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:55.210098 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:55.210543 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:26:55.211231 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:55.211248 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.212090 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.212093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:55.213165 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:55.213175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.213751 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.213755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:55.213993 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.214754 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:26:55.214771 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:26:55.216910 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:26:55.219440 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:55.219451 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:55.219472 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:55.219789 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:55.220173 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:55.220176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:55.220177 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:55.220333 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:55.221127 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:26:55.221134 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:26:55.221460 (+ 326us) client_negotiation.cc:769] Sending connection context
0811 07:26:55.221653 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 07:26:55.222026 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":236,"threads_started":1}
I20260811 07:26:55.224746 12529 heartbeater.cc:347] Connected to a master server at 127.11.248.62:33421
I20260811 07:26:55.225109 12529 heartbeater.cc:464] Registering TS with master...
I20260811 07:26:55.225955 12529 heartbeater.cc:511] Master 127.11.248.62:33421 requested a full tablet report, sending...
I20260811 07:26:55.227836 12316 ts_manager.cc:194] Registered new tserver with Master: accd1bdb1f0b4b06a88b6c919c7e7585 (127.11.248.1:40135)
I20260811 07:26:55.229339 12316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:54789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:26:55.244903 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33421
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:55.411954 12534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:55.412374 12534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:55.412451 12534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:55.417393 12534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:55.417476 12534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:55.417548 12534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:26:55.424041 12534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33421
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:55.425347 12534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:55.426580 12534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:55.441563 12540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:55.441499 12539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:55.441620 12542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:55.441526 12534 server_base.cc:1034] running on GCE node
I20260811 07:26:55.442250 12534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:55.443194 12534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:55.444432 12534 hybrid_clock.cc:648] HybridClock initialized: now 1786433215444412 us; error 44 us; skew 500 ppm
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:55.447788 12534 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:26:55.448901 12534 webserver.cc:460] Webserver started at http://127.11.248.2:37093/ using document root <none> and password file <none>
I20260811 07:26:55.449571 12534 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:55.449649 12534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:55.449856 12534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:55.452289 12534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "744fc2b6b4f84fd79e93a1f675ce49c6"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "db5fa25062751f6e9eb11da1bd9ade48"
server_key_iv: "71aca3cc224bbf278d6d1b6115bbbd71"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.453042 12534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "744fc2b6b4f84fd79e93a1f675ce49c6"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "db5fa25062751f6e9eb11da1bd9ade48"
server_key_iv: "71aca3cc224bbf278d6d1b6115bbbd71"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.457855 12534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:26:55.461043 12549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.462622 12534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:26:55.462790 12534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "744fc2b6b4f84fd79e93a1f675ce49c6"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "db5fa25062751f6e9eb11da1bd9ade48"
server_key_iv: "71aca3cc224bbf278d6d1b6115bbbd71"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.462940 12534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:55.486627 12534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:55.490765 12534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:55.491008 12534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:55.491704 12534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:26:55.492619 12534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:26:55.492666 12534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.492707 12534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:26:55.492722 12534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.511026 12534 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:44831
I20260811 07:26:55.511085 12673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:44831 every 8 connection(s)
I20260811 07:26:55.512120 12534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:26:55.515638 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 12534
I20260811 07:26:55.515787 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:26:55.516058 12256 external_mini_cluster.cc:1428] Setting key f175887a485f3544b49b378b97b0f462
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:26:55.530778 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.514727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:43179 (local address 127.11.248.62:33421)
0811 07:26:55.514944 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:55.514949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:55.516194 (+ 1245us) server_negotiation.cc:407] Connection header received
0811 07:26:55.518479 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:55.518483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:55.518545 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:55.518671 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:55.520462 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.521172 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.522644 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.522903 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.523032 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.526400 (+ 3368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:55.526404 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:55.526407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:55.526437 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:55.528323 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.528998 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.529002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.529006 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.529100 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.529527 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.529534 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.529535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.529740 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:55.529861 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:55.530420 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 07:26:55.530572 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:26:55.531872 12677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.515177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33421 (local address 127.11.248.2:43179)
0811 07:26:55.515978 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:55.516041 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:55.518217 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:55.518951 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:55.518959 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:55.519521 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:26:55.520261 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:55.520284 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.521319 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.521323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:55.522485 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:55.522496 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.523113 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.523118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:55.523378 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.524181 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:26:55.524201 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:26:55.526162 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:26:55.528477 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:55.528485 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:55.528503 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:55.528879 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:55.529203 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:55.529206 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:55.529208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:55.529404 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:55.529858 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:26:55.529865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:26:55.530153 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 07:26:55.530357 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 07:26:55.530815 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":258,"threads_started":1}
I20260811 07:26:55.533267 12674 heartbeater.cc:347] Connected to a master server at 127.11.248.62:33421
I20260811 07:26:55.533617 12674 heartbeater.cc:464] Registering TS with master...
I20260811 07:26:55.534489 12674 heartbeater.cc:511] Master 127.11.248.62:33421 requested a full tablet report, sending...
I20260811 07:26:55.535722 12316 ts_manager.cc:194] Registered new tserver with Master: 744fc2b6b4f84fd79e93a1f675ce49c6 (127.11.248.2:44831)
I20260811 07:26:55.536619 12316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:43179
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:26:55.554209 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33421
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:55.710772 12680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:55.711115 12680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:55.711169 12680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:55.716075 12680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:55.716161 12680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:55.716231 12680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:26:55.722745 12680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33421
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:55.723950 12680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:55.725271 12680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:55.737432 12685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:55.737401 12688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:55.737373 12686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:55.737773 12680 server_base.cc:1034] running on GCE node
I20260811 07:26:55.738284 12680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:55.739075 12680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:55.740288 12680 hybrid_clock.cc:648] HybridClock initialized: now 1786433215740270 us; error 30 us; skew 500 ppm
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:55.744093 12680 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:26:55.745326 12680 webserver.cc:460] Webserver started at http://127.11.248.3:40239/ using document root <none> and password file <none>
I20260811 07:26:55.745921 12680 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:55.746016 12680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:55.746248 12680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:55.748558 12680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "bd9a6a787d6e4aa8bce7db65ecd92488"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "dc5d3a8803456ec586f9a0f44cd43955"
server_key_iv: "b1cd8aabdd6aa6fe4f17f32c49b53fa8"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.749245 12680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "bd9a6a787d6e4aa8bce7db65ecd92488"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "dc5d3a8803456ec586f9a0f44cd43955"
server_key_iv: "b1cd8aabdd6aa6fe4f17f32c49b53fa8"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.753439 12680 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:26:55.756212 12695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.757601 12680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:26:55.757756 12680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "bd9a6a787d6e4aa8bce7db65ecd92488"
format_stamp: "Formatted at 2026-08-11 07:26:55 on dist-test-slave-77v9"
server_key: "dc5d3a8803456ec586f9a0f44cd43955"
server_key_iv: "b1cd8aabdd6aa6fe4f17f32c49b53fa8"
server_key_version: "encryptionkey@0"
I20260811 07:26:55.757884 12680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:55.776110 12680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:55.779623 12680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:55.780040 12680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:55.780902 12680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:26:55.781895 12680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:26:55.781976 12680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.782056 12680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:26:55.782114 12680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:55.800501 12680 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:33867
I20260811 07:26:55.800587 12822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:33867 every 8 connection(s)
I20260811 07:26:55.801752 12680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:26:55.804572 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 12680
I20260811 07:26:55.804736 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:26:55.805153 12256 external_mini_cluster.cc:1428] Setting key f67710a2296f44efacd38ade66fe137f
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:26:55.819492 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.804003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:32781 (local address 127.11.248.62:33421)
0811 07:26:55.804196 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:55.804201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:55.805723 (+ 1522us) server_negotiation.cc:407] Connection header received
0811 07:26:55.807171 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:55.807179 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:55.807229 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:55.807322 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:55.809256 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.809892 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.811248 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.811530 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.811637 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.815224 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:55.815228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:55.815231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:55.815266 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:55.816925 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.817557 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.817561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.817562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.817659 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.818152 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.818155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.818156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.818392 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:55.818481 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:55.819188 (+ 707us) server_negotiation.cc:299] Negotiation successful
0811 07:26:55.819341 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:26:55.820712 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.804530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33421 (local address 127.11.248.3:32781)
0811 07:26:55.805545 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:55.805597 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:55.806926 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:55.807554 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:55.807564 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:55.808294 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:26:55.809081 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:55.809101 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.810032 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.810043 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:55.811081 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:55.811093 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.811702 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.811705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:55.811974 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.812793 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:26:55.812915 (+ 122us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:26:55.814978 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:26:55.817070 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:55.817076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:55.817091 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:55.817403 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:55.817795 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:55.817798 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:55.817799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:55.818003 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:55.818498 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:26:55.818504 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:26:55.818789 (+ 285us) client_negotiation.cc:769] Sending connection context
0811 07:26:55.819046 (+ 257us) client_negotiation.cc:240] Negotiation successful
0811 07:26:55.819445 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"thread_start_us":274,"threads_started":1}
I20260811 07:26:55.822104 12823 heartbeater.cc:347] Connected to a master server at 127.11.248.62:33421
I20260811 07:26:55.822402 12823 heartbeater.cc:464] Registering TS with master...
I20260811 07:26:55.823009 12823 heartbeater.cc:511] Master 127.11.248.62:33421 requested a full tablet report, sending...
I20260811 07:26:55.824301 12316 ts_manager.cc:194] Registered new tserver with Master: bd9a6a787d6e4aa8bce7db65ecd92488 (127.11.248.3:33867)
I20260811 07:26:55.825068 12316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:32781
I20260811 07:26:55.833667 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:26:55.870671 12831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.859051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34406 (local address 127.11.248.1:40135)
0811 07:26:55.859418 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:55.859425 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:55.859453 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:26:55.859655 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:55.859663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:55.859922 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:55.860061 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:55.860929 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.861901 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.863007 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.863443 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.863536 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.866277 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:55.866323 (+ 46us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:55.866344 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:55.866389 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:55.868576 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.869246 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.869253 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.869254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.869343 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.869617 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.869619 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.869620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.869890 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:55.870139 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:55.870323 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 07:26:55.870485 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":142,"threads_started":1}
W20260811 07:26:55.871886 12430 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34406
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:26:55 dist-test-slave-77v9 krb5kdc[12263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:26:55.903043 12831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:55.893493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34408 (local address 127.11.248.1:40135)
0811 07:26:55.893720 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:55.893725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:55.893909 (+ 184us) server_negotiation.cc:407] Connection header received
0811 07:26:55.894136 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:55.894139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:55.894188 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:55.894278 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:55.895179 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.895699 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.896596 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:55.896886 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:55.896995 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:55.899757 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:55.899760 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:55.899762 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:55.899792 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:55.901367 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.901899 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.901902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.901903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.901990 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:55.902251 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:55.902254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:55.902255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:55.902432 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:55.902534 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:55.902747 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 07:26:55.902911 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:26:55.904309 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 12384
I20260811 07:26:55.912390 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 12534
I20260811 07:26:55.920660 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 12680
I20260811 07:26:55.930789 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 12278
2026-08-11T07:26:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2673 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:26:56 dist-test-slave-77v9 krb5kdc[12838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:26:56 dist-test-slave-77v9 krb5kdc[12838](info): set up 2 sockets
Aug 11 07:26:56 dist-test-slave-77v9 krb5kdc[12838](info): commencing operation
krb5kdc: starting...
W20260811 07:26:57.078548 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:26:57 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:26:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:26:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:26:57.224663 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36557
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:57.340884 12855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:57.341198 12855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:57.341243 12855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:57.345448 12855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:26:57.345530 12855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:57.345549 12855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:57.345566 12855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:26:57.345582 12855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:26:57.351902 12855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:57.353264 12855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:57.354406 12855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:57.364051 12860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:57.364095 12855 server_base.cc:1034] running on GCE node
W20260811 07:26:57.364051 12861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:57.364053 12863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:57.365037 12855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:57.366248 12855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:57.367434 12855 hybrid_clock.cc:648] HybridClock initialized: now 1786433217367411 us; error 50 us; skew 500 ppm
Aug 11 07:26:57 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433217, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:57.370702 12855 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:26:57.371806 12855 webserver.cc:460] Webserver started at http://127.11.248.62:42045/ using document root <none> and password file <none>
I20260811 07:26:57.372423 12855 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:57.372522 12855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:57.372776 12855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:57.375044 12855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "a8598b244e804a768e9b690effd242cd"
format_stamp: "Formatted at 2026-08-11 07:26:57 on dist-test-slave-77v9"
server_key: "c9fa3173ec1270fde5398362b4b1e16f"
server_key_iv: "15cf5daf27ee3399c4bff488800bb26a"
server_key_version: "encryptionkey@0"
I20260811 07:26:57.375685 12855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "a8598b244e804a768e9b690effd242cd"
format_stamp: "Formatted at 2026-08-11 07:26:57 on dist-test-slave-77v9"
server_key: "c9fa3173ec1270fde5398362b4b1e16f"
server_key_iv: "15cf5daf27ee3399c4bff488800bb26a"
server_key_version: "encryptionkey@0"
I20260811 07:26:57.379792 12855 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:26:57.382517 12870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:57.383755 12855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:26:57.383991 12855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "a8598b244e804a768e9b690effd242cd"
format_stamp: "Formatted at 2026-08-11 07:26:57 on dist-test-slave-77v9"
server_key: "c9fa3173ec1270fde5398362b4b1e16f"
server_key_iv: "15cf5daf27ee3399c4bff488800bb26a"
server_key_version: "encryptionkey@0"
I20260811 07:26:57.384135 12855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:57.401494 12855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:57.405215 12855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:57.405457 12855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:57.413364 12855 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:36557
I20260811 07:26:57.413422 12928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:36557 every 8 connection(s)
I20260811 07:26:57.414453 12855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:26:57.417721 12929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:26:57.423079 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 12855
I20260811 07:26:57.423236 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:26:57.423507 12256 external_mini_cluster.cc:1428] Setting key e3d01b59c6385ad7cf13a9489e9bcb45
I20260811 07:26:57.423992 12929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd: Bootstrap starting.
I20260811 07:26:57.426990 12929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd: Neither blocks nor log segments found. Creating new log.
I20260811 07:26:57.428041 12929 log.cc:824] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:26:57.430979 12929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd: No bootstrap required, opened a new log
I20260811 07:26:57.435920 12929 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8598b244e804a768e9b690effd242cd" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36557 } }
I20260811 07:26:57.436355 12929 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:26:57.436427 12929 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8598b244e804a768e9b690effd242cd, State: Initialized, Role: FOLLOWER
I20260811 07:26:57.437086 12929 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8598b244e804a768e9b690effd242cd" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36557 } }
I20260811 07:26:57.437240 12929 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:26:57.437290 12929 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:26:57.437362 12929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:26:57.438747 12929 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8598b244e804a768e9b690effd242cd" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36557 } }
I20260811 07:26:57.439237 12929 leader_election.cc:302] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8598b244e804a768e9b690effd242cd; no voters:
I20260811 07:26:57.439679 12929 leader_election.cc:288] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:26:57.439780 12934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:26:57.439993 12934 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [term 1 LEADER]: Becoming Leader. State: Replica: a8598b244e804a768e9b690effd242cd, State: Running, Role: LEADER
Aug 11 07:26:57 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:26:57.440335 12934 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8598b244e804a768e9b690effd242cd" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36557 } }
I20260811 07:26:57.441226 12929 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:26:57.441684 12934 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8598b244e804a768e9b690effd242cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8598b244e804a768e9b690effd242cd" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36557 } } }
I20260811 07:26:57.441805 12934 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [sys.catalog]: This master's current role is: LEADER
I20260811 07:26:57.442010 12934 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8598b244e804a768e9b690effd242cd. Latest consensus state: current_term: 1 leader_uuid: "a8598b244e804a768e9b690effd242cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8598b244e804a768e9b690effd242cd" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36557 } } }
I20260811 07:26:57.442104 12934 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd [sys.catalog]: This master's current role is: LEADER
W20260811 07:26:57.447141 12949 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:26:57.447264 12949 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:26:57.447340 12938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:26:57.448088 12938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:26:57.448706 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:57.425135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.11.248.62:36557)
0811 07:26:57.425670 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:57.425686 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:57.425723 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:26:57.426520 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:57.426569 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:57.427102 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:57.427513 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:57.429320 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:57.431178 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:57.432406 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:57.437370 (+ 4964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:57.437593 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:57.441282 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:57.441292 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:57.441362 (+ 70us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:57.441409 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:57.444465 (+ 3056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:57.445176 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:57.445185 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:57.445195 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:57.445362 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:57.445733 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:57.445739 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:57.445744 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:57.446331 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:57.446575 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:57.446942 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 07:26:57.447397 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":178,"threads_started":1}
I20260811 07:26:57.455044 12938 catalog_manager.cc:1347] Generated new cluster ID: 49094d3e96774a708257b38480fea12d
I20260811 07:26:57.455150 12938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:26:57.472980 12938 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:26:57.474527 12938 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:26:57.483840 12938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8598b244e804a768e9b690effd242cd: Generated new TSK 0
I20260811 07:26:57.484747 12938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
W20260811 07:26:58.687847 12256 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.248.1: real 1.194s user 0.005s sys 0.001s
I20260811 07:26:58.688591 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36557
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:58.808923 12955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:58.809222 12955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:58.809271 12955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:58.813441 12955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:58.813522 12955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:58.813628 12955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:26:58.819689 12955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36557
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:58.821065 12955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:58.822240 12955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:58.833320 12960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:58.833343 12963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:58.833320 12961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:58.834002 12955 server_base.cc:1034] running on GCE node
I20260811 07:26:58.834462 12955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:58.835165 12955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:58.836377 12955 hybrid_clock.cc:648] HybridClock initialized: now 1786433218836350 us; error 47 us; skew 500 ppm
Aug 11 07:26:58 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:58.839692 12955 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:26:58.841038 12955 webserver.cc:460] Webserver started at http://127.11.248.1:41753/ using document root <none> and password file <none>
I20260811 07:26:58.841706 12955 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:58.841820 12955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:58.842079 12955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:58.844480 12955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "5f324cd0aca6431a90eb963bea75d8c7"
format_stamp: "Formatted at 2026-08-11 07:26:58 on dist-test-slave-77v9"
server_key: "96ddba8578dccf6e92ce74fb989dee5a"
server_key_iv: "32e3c6aa41a397caf3c57410ccf6febe"
server_key_version: "encryptionkey@0"
I20260811 07:26:58.845173 12955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "5f324cd0aca6431a90eb963bea75d8c7"
format_stamp: "Formatted at 2026-08-11 07:26:58 on dist-test-slave-77v9"
server_key: "96ddba8578dccf6e92ce74fb989dee5a"
server_key_iv: "32e3c6aa41a397caf3c57410ccf6febe"
server_key_version: "encryptionkey@0"
I20260811 07:26:58.849627 12955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:26:58.852454 12971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:58.854067 12955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:26:58.854241 12955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "5f324cd0aca6431a90eb963bea75d8c7"
format_stamp: "Formatted at 2026-08-11 07:26:58 on dist-test-slave-77v9"
server_key: "96ddba8578dccf6e92ce74fb989dee5a"
server_key_iv: "32e3c6aa41a397caf3c57410ccf6febe"
server_key_version: "encryptionkey@0"
I20260811 07:26:58.854403 12955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:58.864387 12955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:58.868264 12955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:58.868520 12955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:58.869289 12955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:26:58.870215 12955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:26:58.870301 12955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:58.870400 12955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:26:58.870447 12955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:58.881103 12955 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:45095
I20260811 07:26:58.881143 13097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:45095 every 8 connection(s)
I20260811 07:26:58.882440 12955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:26:58.888088 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 12955
I20260811 07:26:58.888223 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:26:58.888530 12256 external_mini_cluster.cc:1428] Setting key bcf790af52f6e544b8e45ed1b2b7c470
Aug 11 07:26:58 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:26:58.900041 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:58.884581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50457 (local address 127.11.248.62:36557)
0811 07:26:58.884903 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:58.884906 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:58.886254 (+ 1348us) server_negotiation.cc:407] Connection header received
0811 07:26:58.887675 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:58.887679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:58.887751 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:58.887929 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:58.889799 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:58.890559 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:58.892415 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:58.892657 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:58.892808 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:58.895718 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:58.895721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:58.895723 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:58.895750 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:58.897616 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:58.898301 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:58.898304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:58.898306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:58.898405 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:58.898785 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:58.898788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:58.898790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:58.899001 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:58.899116 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:58.899677 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 07:26:58.899838 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":214,"thread_start_us":140,"threads_started":1}
I20260811 07:26:58.900985 13101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:58.885087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36557 (local address 127.11.248.1:50457)
0811 07:26:58.886049 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:58.886097 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:58.887369 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:58.888279 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:58.888292 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:58.888893 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:26:58.889590 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:58.889612 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:58.890706 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:58.890710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:58.892250 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:58.892266 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:58.892961 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:58.892965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:58.893159 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:58.893872 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:26:58.893891 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:26:58.895495 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:26:58.897775 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:58.897784 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:58.897805 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:58.898161 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:58.898507 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:58.898510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:58.898512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:58.898675 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:58.899118 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:26:58.899128 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:26:58.899417 (+ 289us) client_negotiation.cc:769] Sending connection context
0811 07:26:58.899619 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 07:26:58.899999 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"thread_start_us":152,"threads_started":1}
I20260811 07:26:58.902309 13098 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36557
I20260811 07:26:58.902592 13098 heartbeater.cc:464] Registering TS with master...
I20260811 07:26:58.903223 13098 heartbeater.cc:511] Master 127.11.248.62:36557 requested a full tablet report, sending...
I20260811 07:26:58.904945 12887 ts_manager.cc:194] Registered new tserver with Master: 5f324cd0aca6431a90eb963bea75d8c7 (127.11.248.1:45095)
I20260811 07:26:58.906155 12887 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:50457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
W20260811 07:26:59.244462 12256 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.248.2: real 0.354s user 0.001s sys 0.004s
I20260811 07:26:59.245121 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36557
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:59.364392 13104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:59.364725 13104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:59.364838 13104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:59.369051 13104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:59.369155 13104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:59.369253 13104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:26:59.374970 13104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36557
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:59.376171 13104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:59.377314 13104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:59.387723 13112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:59.387907 13104 server_base.cc:1034] running on GCE node
W20260811 07:26:59.387923 13110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:59.387723 13109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:59.388520 13104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:59.389321 13104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:59.390523 13104 hybrid_clock.cc:648] HybridClock initialized: now 1786433219390510 us; error 30 us; skew 500 ppm
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:59.393785 13104 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:26:59.394914 13104 webserver.cc:460] Webserver started at http://127.11.248.2:34277/ using document root <none> and password file <none>
I20260811 07:26:59.395536 13104 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:59.395637 13104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:59.395917 13104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:59.398245 13104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "9f4a13fb5a624d038a448235128d7e91"
format_stamp: "Formatted at 2026-08-11 07:26:59 on dist-test-slave-77v9"
server_key: "04940166e5269f426493b239b9410d2e"
server_key_iv: "fe41bba5dcb148aa3f2b68ccfa3a885c"
server_key_version: "encryptionkey@0"
I20260811 07:26:59.398885 13104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "9f4a13fb5a624d038a448235128d7e91"
format_stamp: "Formatted at 2026-08-11 07:26:59 on dist-test-slave-77v9"
server_key: "04940166e5269f426493b239b9410d2e"
server_key_iv: "fe41bba5dcb148aa3f2b68ccfa3a885c"
server_key_version: "encryptionkey@0"
I20260811 07:26:59.403165 13104 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:26:59.405845 13120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:59.407160 13104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:26:59.407317 13104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "9f4a13fb5a624d038a448235128d7e91"
format_stamp: "Formatted at 2026-08-11 07:26:59 on dist-test-slave-77v9"
server_key: "04940166e5269f426493b239b9410d2e"
server_key_iv: "fe41bba5dcb148aa3f2b68ccfa3a885c"
server_key_version: "encryptionkey@0"
I20260811 07:26:59.407450 13104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:59.433238 13104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:59.437896 13104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:59.438210 13104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:59.439054 13104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:26:59.440282 13104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:26:59.440353 13104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:59.440424 13104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:26:59.440456 13104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:59.451203 13104 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:34997
I20260811 07:26:59.451233 13241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:34997 every 8 connection(s)
I20260811 07:26:59.452186 13104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:26:59.457211 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 13104
I20260811 07:26:59.457379 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:26:59.457696 12256 external_mini_cluster.cc:1428] Setting key 2ebe2b4ccf0cb5684eb99813936b2704
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:26:59.469259 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.454269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:35263 (local address 127.11.248.62:36557)
0811 07:26:59.454536 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.454539 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.455632 (+ 1093us) server_negotiation.cc:407] Connection header received
0811 07:26:59.456593 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.456597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.456669 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.456793 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:59.458692 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.459456 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.460947 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.461198 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.461326 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.464479 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:59.464482 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:59.464484 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:59.464513 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:59.466352 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.467149 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.467153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.467154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.467263 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.467715 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.467718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.467719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.468001 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:59.468086 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.468977 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.469112 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":102,"threads_started":1}
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:26:59.470384 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.454593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36557 (local address 127.11.248.2:35263)
0811 07:26:59.455441 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.455488 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.456357 (+ 869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.457054 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.457066 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.457714 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:26:59.458505 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.458525 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.459663 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.459666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.460739 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.460750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.461377 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.461382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.461606 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.462323 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:26:59.462343 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:26:59.464235 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:26:59.466513 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:59.466522 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:59.466546 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:59.467002 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:59.467374 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:59.467378 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:59.467380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:59.467599 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:59.468126 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:26:59.468134 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:26:59.468541 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.468850 (+ 309us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.469288 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":124,"threads_started":1}
I20260811 07:26:59.471725 13242 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36557
I20260811 07:26:59.472045 13242 heartbeater.cc:464] Registering TS with master...
I20260811 07:26:59.472671 13242 heartbeater.cc:511] Master 127.11.248.62:36557 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:26:59.473997 12887 ts_manager.cc:194] Registered new tserver with Master: 9f4a13fb5a624d038a448235128d7e91 (127.11.248.2:34997)
I20260811 07:26:59.474869 12887 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:35263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:26:59.492640 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36557
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:26:59.622924 13250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:26:59.623303 13250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:26:59.623399 13250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:26:59.628082 13250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:26:59.628216 13250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:26:59.628336 13250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:26:59.634974 13250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36557
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:26:59.636293 13250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:26:59.637569 13250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:26:59.649128 13257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:59.649050 13259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:26:59.649088 13256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:26:59.649408 13250 server_base.cc:1034] running on GCE node
I20260811 07:26:59.650018 13250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:26:59.650784 13250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:26:59.651974 13250 hybrid_clock.cc:648] HybridClock initialized: now 1786433219651956 us; error 33 us; skew 500 ppm
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:26:59.655143 13250 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:26:59.656164 13250 webserver.cc:460] Webserver started at http://127.11.248.3:44927/ using document root <none> and password file <none>
I20260811 07:26:59.656737 13250 fs_manager.cc:359] Metadata directory not provided
I20260811 07:26:59.656803 13250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:26:59.657076 13250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:26:59.659385 13250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "6343661e1fb64d419129f26549e60762"
format_stamp: "Formatted at 2026-08-11 07:26:59 on dist-test-slave-77v9"
server_key: "586b37e67420efc7b891c653d7ff7fe4"
server_key_iv: "520e6165e291b60cb227af447663aeb4"
server_key_version: "encryptionkey@0"
I20260811 07:26:59.659991 13250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "6343661e1fb64d419129f26549e60762"
format_stamp: "Formatted at 2026-08-11 07:26:59 on dist-test-slave-77v9"
server_key: "586b37e67420efc7b891c653d7ff7fe4"
server_key_iv: "520e6165e291b60cb227af447663aeb4"
server_key_version: "encryptionkey@0"
I20260811 07:26:59.664160 13250 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:26:59.666961 13266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:59.668423 13250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:26:59.668579 13250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "6343661e1fb64d419129f26549e60762"
format_stamp: "Formatted at 2026-08-11 07:26:59 on dist-test-slave-77v9"
server_key: "586b37e67420efc7b891c653d7ff7fe4"
server_key_iv: "520e6165e291b60cb227af447663aeb4"
server_key_version: "encryptionkey@0"
I20260811 07:26:59.668710 13250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:26:59.701498 13250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:26:59.705605 13250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:26:59.705895 13250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:26:59.706595 13250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:26:59.707537 13250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:26:59.707587 13250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:59.707659 13250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:26:59.707695 13250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:26:59.719625 13250 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:33855
I20260811 07:26:59.719803 13398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:33855 every 8 connection(s)
I20260811 07:26:59.720659 13250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:26:59.722172 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 13250
I20260811 07:26:59.722307 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:26:59.722651 12256 external_mini_cluster.cc:1428] Setting key 72411dcc5e0ac5ed92bbec79fdd555ce
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:26:59.735682 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.722778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:51521 (local address 127.11.248.62:36557)
0811 07:26:59.722986 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.722990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.723986 (+ 996us) server_negotiation.cc:407] Connection header received
0811 07:26:59.725125 (+ 1139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.725128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.725188 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.725269 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:59.726540 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.727096 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.728306 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.728560 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.728680 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.731644 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:59.731648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:59.731651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:59.731688 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:59.733349 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.733961 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.733965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.733967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.734058 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.734453 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.734458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.734459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.734669 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:59.734779 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.735344 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.735500 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 07:26:59.736672 13402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.723245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36557 (local address 127.11.248.3:51521)
0811 07:26:59.723815 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.723879 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.724907 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.725457 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.725464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.725844 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:26:59.726362 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.726376 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.727234 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.727238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.728159 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.728169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.728728 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.728732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.728987 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.729694 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:26:59.729712 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:26:59.731438 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:26:59.733500 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:59.733506 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:59.733526 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:59.733835 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:59.734169 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:26:59.734172 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:26:59.734174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:26:59.734351 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:26:59.734791 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:26:59.734808 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:26:59.735088 (+ 280us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.735295 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.735660 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":154,"threads_started":1}
I20260811 07:26:59.737960 13399 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36557
I20260811 07:26:59.738255 13399 heartbeater.cc:464] Registering TS with master...
I20260811 07:26:59.738803 13399 heartbeater.cc:511] Master 127.11.248.62:36557 requested a full tablet report, sending...
I20260811 07:26:59.739894 12887 ts_manager.cc:194] Registered new tserver with Master: 6343661e1fb64d419129f26549e60762 (127.11.248.3:33855)
I20260811 07:26:59.740509 12887 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:51521
I20260811 07:26:59.749635 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:26:59.761693 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.753700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60138 (local address 127.11.248.62:36557)
0811 07:26:59.753842 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.753845 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.753988 (+ 143us) server_negotiation.cc:407] Connection header received
0811 07:26:59.754089 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.754091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.754138 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.754223 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:59.755037 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.755578 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.756442 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.756660 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.756736 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.758402 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:59.758406 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:59.758409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:59.758434 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:59.760026 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.760449 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.760452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.760453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.760531 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.760765 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.760767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.760768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.761103 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:59.761216 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.761460 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.761567 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:26:59.767184 12887 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:26:59.771135 12887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:26:59.789131 13417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.782148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45095 (local address 127.0.0.1:43070)
0811 07:26:59.783469 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.783529 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.783683 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.784520 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.784527 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.784551 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:26:59.784863 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.784876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.786029 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.786032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.787339 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.787351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.788461 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.788464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.788595 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.788642 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.788779 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.788952 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1097,"mutex_wait_us":82,"spinlock_wait_cycles":8192,"thread_start_us":127,"threads_started":1}
I20260811 07:26:59.789148 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.782345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43070 (local address 127.11.248.1:45095)
0811 07:26:59.783714 (+ 1369us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.783722 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.783749 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:26:59.784084 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.784090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.784332 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.784493 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:26:59.785031 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.785878 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.787472 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.788337 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.788529 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.788696 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.788830 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.788933 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1253,"thread_start_us":127,"threads_started":1}
I20260811 07:26:59.790269 13414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.782159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:33855 (local address 127.0.0.1:43880)
0811 07:26:59.783468 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.783528 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.783684 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.784620 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.784626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.784648 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:26:59.784934 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.784946 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.786609 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.786613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.788245 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.788258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.789810 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.789814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.789931 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.789956 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.790009 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.790081 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1111,"mutex_wait_us":450,"spinlock_wait_cycles":22272,"thread_start_us":174,"threads_started":1}
I20260811 07:26:59.791054 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.783075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43880 (local address 127.11.248.3:33855)
0811 07:26:59.784189 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.784204 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.784224 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:26:59.784301 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.784306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.784470 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.784765 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:26:59.785044 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.786401 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.788395 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.789653 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.790573 (+ 920us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.790752 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.790815 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.790909 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1014,"thread_start_us":282,"threads_started":1}
I20260811 07:26:59.791145 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.782504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34997 (local address 127.0.0.1:54534)
0811 07:26:59.783931 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.783943 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.784014 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.784671 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.784673 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.784694 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:26:59.784992 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.785002 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.786609 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.786613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.788253 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.788259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.790693 (+ 2434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.790696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.790771 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.790790 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.790903 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.790984 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1355,"mutex_wait_us":287,"spinlock_wait_cycles":1920,"thread_start_us":644,"threads_started":1}
I20260811 07:26:59.791237 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.782806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54534 (local address 127.11.248.2:34997)
0811 07:26:59.783964 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.783977 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.784000 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:26:59.784180 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.784186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.784346 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.784530 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:26:59.785109 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.786435 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.788421 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.789399 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.789489 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.789640 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.790948 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.791059 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1042,"thread_start_us":128,"threads_started":1}
I20260811 07:26:59.793200 13023 tablet_service.cc:1467] Processing CreateTablet for tablet 1084a56b7074452eb56132695daf221c (DEFAULT_TABLE table=test-table [id=32f48d3349f64086a611841fa7613524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:26:59.793737 13324 tablet_service.cc:1467] Processing CreateTablet for tablet 1084a56b7074452eb56132695daf221c (DEFAULT_TABLE table=test-table [id=32f48d3349f64086a611841fa7613524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:26:59.793973 13173 tablet_service.cc:1467] Processing CreateTablet for tablet 1084a56b7074452eb56132695daf221c (DEFAULT_TABLE table=test-table [id=32f48d3349f64086a611841fa7613524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:26:59.794521 13023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1084a56b7074452eb56132695daf221c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:26:59.794894 13324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1084a56b7074452eb56132695daf221c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:26:59.794950 13173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1084a56b7074452eb56132695daf221c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:26:59.802630 13424 tablet_bootstrap.cc:492] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: Bootstrap starting.
I20260811 07:26:59.803200 13423 tablet_bootstrap.cc:492] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: Bootstrap starting.
I20260811 07:26:59.803959 13425 tablet_bootstrap.cc:492] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: Bootstrap starting.
I20260811 07:26:59.807540 13423 tablet_bootstrap.cc:654] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: Neither blocks nor log segments found. Creating new log.
I20260811 07:26:59.807812 13424 tablet_bootstrap.cc:654] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: Neither blocks nor log segments found. Creating new log.
I20260811 07:26:59.808635 13425 tablet_bootstrap.cc:654] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: Neither blocks nor log segments found. Creating new log.
I20260811 07:26:59.809101 13424 log.cc:824] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: Log is configured to *not* fsync() on all Append() calls
I20260811 07:26:59.809417 13423 log.cc:824] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:26:59.810174 13425 log.cc:824] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: Log is configured to *not* fsync() on all Append() calls
I20260811 07:26:59.811858 13423 tablet_bootstrap.cc:492] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: No bootstrap required, opened a new log
I20260811 07:26:59.811872 13424 tablet_bootstrap.cc:492] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: No bootstrap required, opened a new log
I20260811 07:26:59.812089 13424 ts_tablet_manager.cc:1397] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260811 07:26:59.812177 13423 ts_tablet_manager.cc:1397] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 07:26:59.812717 13425 tablet_bootstrap.cc:492] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: No bootstrap required, opened a new log
I20260811 07:26:59.812958 13425 ts_tablet_manager.cc:1397] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260811 07:26:59.817338 13423 raft_consensus.cc:348] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.817744 13423 raft_consensus.cc:374] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:26:59.817809 13423 raft_consensus.cc:729] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f324cd0aca6431a90eb963bea75d8c7, State: Initialized, Role: FOLLOWER
I20260811 07:26:59.818306 13423 consensus_queue.cc:260] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.818574 13424 raft_consensus.cc:348] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.819144 13424 raft_consensus.cc:374] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:26:59.819223 13424 raft_consensus.cc:729] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6343661e1fb64d419129f26549e60762, State: Initialized, Role: FOLLOWER
I20260811 07:26:59.819305 13098 heartbeater.cc:503] Master 127.11.248.62:36557 was elected leader, sending a full tablet report...
I20260811 07:26:59.819015 13425 raft_consensus.cc:348] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.819399 13425 raft_consensus.cc:374] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:26:59.819465 13425 raft_consensus.cc:729] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4a13fb5a624d038a448235128d7e91, State: Initialized, Role: FOLLOWER
I20260811 07:26:59.819779 13423 ts_tablet_manager.cc:1428] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 07:26:59.819780 13424 consensus_queue.cc:260] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.819876 13425 consensus_queue.cc:260] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.820732 13399 heartbeater.cc:503] Master 127.11.248.62:36557 was elected leader, sending a full tablet report...
I20260811 07:26:59.821018 13425 ts_tablet_manager.cc:1428] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260811 07:26:59.821089 13242 heartbeater.cc:503] Master 127.11.248.62:36557 was elected leader, sending a full tablet report...
I20260811 07:26:59.823860 13424 ts_tablet_manager.cc:1428] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260811 07:26:59.836879 13429 raft_consensus.cc:482] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:26:59.837210 13429 raft_consensus.cc:504] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.838518 13429 leader_election.cc:288] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6343661e1fb64d419129f26549e60762 (127.11.248.3:33855), 9f4a13fb5a624d038a448235128d7e91 (127.11.248.2:34997)
I20260811 07:26:59.843585 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.838874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:55233 (local address 127.11.248.3:33855)
0811 07:26:59.839035 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.839051 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.839569 (+ 518us) server_negotiation.cc:407] Connection header received
0811 07:26:59.839718 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.839720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.839795 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.839880 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:26:59.840226 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.840792 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.842320 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.842925 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.843074 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.843169 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.843378 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.843460 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:26:59.843689 13432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.838862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:33855 (local address 127.11.248.1:55233)
0811 07:26:59.839402 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.839414 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.839583 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.839917 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.839920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.839940 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:26:59.840105 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.840110 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.840976 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.840980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.842175 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.842190 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.843069 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.843073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.843233 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.843256 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.843359 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.843437 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":38,"thread_start_us":217,"threads_started":1}
I20260811 07:26:59.844079 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.839002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49447 (local address 127.11.248.2:34997)
0811 07:26:59.839152 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.839157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.839510 (+ 353us) server_negotiation.cc:407] Connection header received
0811 07:26:59.839666 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.839669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.839728 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.839846 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:26:59.840388 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.841124 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.842706 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.843400 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.843547 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.843601 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.843871 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.843954 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:26:59.844547 13433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.838853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34997 (local address 127.11.248.1:49447)
0811 07:26:59.839389 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 07:26:59.839403 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:26:59.839541 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:26:59.839826 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:26:59.839831 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:26:59.839854 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:26:59.840208 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.840216 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.841249 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.841252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.842585 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:26:59.842596 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.843539 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.843543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:26:59.843662 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.843696 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:26:59.844303 (+ 607us) client_negotiation.cc:240] Negotiation successful
0811 07:26:59.844391 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":6,"spinlock_wait_cycles":31872,"thread_start_us":241,"threads_started":1}
I20260811 07:26:59.844606 13350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1084a56b7074452eb56132695daf221c" candidate_uuid: "5f324cd0aca6431a90eb963bea75d8c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6343661e1fb64d419129f26549e60762" is_pre_election: true
I20260811 07:26:59.845010 13350 raft_consensus.cc:2454] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f324cd0aca6431a90eb963bea75d8c7 in term 0.
I20260811 07:26:59.845690 13194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1084a56b7074452eb56132695daf221c" candidate_uuid: "5f324cd0aca6431a90eb963bea75d8c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4a13fb5a624d038a448235128d7e91" is_pre_election: true
I20260811 07:26:59.845732 12973 leader_election.cc:302] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f324cd0aca6431a90eb963bea75d8c7, 6343661e1fb64d419129f26549e60762; no voters:
I20260811 07:26:59.846017 13194 raft_consensus.cc:2454] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f324cd0aca6431a90eb963bea75d8c7 in term 0.
I20260811 07:26:59.846074 13429 raft_consensus.cc:2781] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:26:59.846208 13429 raft_consensus.cc:482] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:26:59.846298 13429 raft_consensus.cc:3037] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:26:59.847615 13429 raft_consensus.cc:504] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.848067 13429 leader_election.cc:288] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [CANDIDATE]: Term 1 election: Requested vote from peers 6343661e1fb64d419129f26549e60762 (127.11.248.3:33855), 9f4a13fb5a624d038a448235128d7e91 (127.11.248.2:34997)
I20260811 07:26:59.848604 13350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1084a56b7074452eb56132695daf221c" candidate_uuid: "5f324cd0aca6431a90eb963bea75d8c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6343661e1fb64d419129f26549e60762"
I20260811 07:26:59.848649 13194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1084a56b7074452eb56132695daf221c" candidate_uuid: "5f324cd0aca6431a90eb963bea75d8c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f4a13fb5a624d038a448235128d7e91"
I20260811 07:26:59.848774 13350 raft_consensus.cc:3037] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:26:59.848904 13194 raft_consensus.cc:3037] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:26:59.850463 13194 raft_consensus.cc:2454] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f324cd0aca6431a90eb963bea75d8c7 in term 1.
I20260811 07:26:59.850795 12974 leader_election.cc:302] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f324cd0aca6431a90eb963bea75d8c7, 9f4a13fb5a624d038a448235128d7e91; no voters:
I20260811 07:26:59.850965 13350 raft_consensus.cc:2454] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f324cd0aca6431a90eb963bea75d8c7 in term 1.
I20260811 07:26:59.851023 13429 raft_consensus.cc:2781] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:26:59.851354 13429 raft_consensus.cc:686] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [term 1 LEADER]: Becoming Leader. State: Replica: 5f324cd0aca6431a90eb963bea75d8c7, State: Running, Role: LEADER
I20260811 07:26:59.851818 13429 consensus_queue.cc:237] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } }
I20260811 07:26:59.856001 12886 catalog_manager.cc:5495] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f324cd0aca6431a90eb963bea75d8c7 (127.11.248.1). New cstate: current_term: 1 leader_uuid: "5f324cd0aca6431a90eb963bea75d8c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f324cd0aca6431a90eb963bea75d8c7" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6343661e1fb64d419129f26549e60762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4a13fb5a624d038a448235128d7e91" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34997 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
W20260811 07:26:59.884589 13099 tablet.cc:2369] T 1084a56b7074452eb56132695daf221c P 5f324cd0aca6431a90eb963bea75d8c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:26:59.885084 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.868935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43072 (local address 127.11.248.1:45095)
0811 07:26:59.869135 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.869141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.869453 (+ 312us) server_negotiation.cc:407] Connection header received
0811 07:26:59.869656 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.869658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.869715 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.869785 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:59.870731 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.871269 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.872445 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.872698 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.872790 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.875986 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:59.876003 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:59.876025 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:59.876065 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:59.882375 (+ 6310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.882999 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.883011 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.883012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.883169 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.883528 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.883531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.883533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.883840 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:59.884209 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.884430 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.884578 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:26:59.923051 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.911038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43084 (local address 127.11.248.1:45095)
0811 07:26:59.911217 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.911226 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.911403 (+ 177us) server_negotiation.cc:407] Connection header received
0811 07:26:59.911546 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.911549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.911598 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.911692 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:59.912699 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.913358 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.914322 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.914578 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.914676 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.917729 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:59.917732 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:59.917734 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:59.917767 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:59.920212 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.920878 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.920882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.920884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.921040 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.921597 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.921603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.921608 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.921919 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:59.922090 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.922582 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.922805 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260811 07:26:59.953552 13243 tablet.cc:2369] T 1084a56b7074452eb56132695daf221c P 9f4a13fb5a624d038a448235128d7e91: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:26:59 dist-test-slave-77v9 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:26:59.970118 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:26:59.957197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43100 (local address 127.11.248.1:45095)
0811 07:26:59.957359 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:26:59.957366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:26:59.957628 (+ 262us) server_negotiation.cc:407] Connection header received
0811 07:26:59.957843 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:26:59.957848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:26:59.957910 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:26:59.958008 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:26:59.958850 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.959706 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.960953 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:26:59.961437 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:26:59.961610 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:26:59.965365 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:26:59.965373 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:26:59.965376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:26:59.965416 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:26:59.967611 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.968294 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.968301 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.968305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.968423 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:26:59.968840 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:26:59.968846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:26:59.968849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:26:59.969138 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:26:59.969325 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:26:59.969681 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:26:59.969863 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 07:26:59.972194 13003 tablet_service.cc:2908] Rejecting scan request for tablet 1084a56b7074452eb56132695daf221c: Uninitialized: clean time has not yet been initialized
W20260811 07:26:59.973075 13401 tablet.cc:2369] T 1084a56b7074452eb56132695daf221c P 6343661e1fb64d419129f26549e60762: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:26:59.974836 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 12955
I20260811 07:26:59.985242 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 13104
I20260811 07:26:59.995119 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 13250
I20260811 07:27:00.003887 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 12855
2026-08-11T07:27:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4071 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:00 dist-test-slave-77v9 krb5kdc[13451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:00 dist-test-slave-77v9 krb5kdc[13451](info): set up 2 sockets
Aug 11 07:27:00 dist-test-slave-77v9 krb5kdc[13451](info): commencing operation
krb5kdc: starting...
W20260811 07:27:01.140631 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:01 dist-test-slave-77v9 krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:01.285020 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36509
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:01.401587 13465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:01.401978 13465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:01.402077 13465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:01.406364 13465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:01.406522 13465 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:27:01.406558 13465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:01.406602 13465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:01.406656 13465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:01.406694 13465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:01.412569 13465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36509
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:01.413883 13465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:01.415015 13465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:01.424515 13471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:01.424564 13474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:01.424690 13465 server_base.cc:1034] running on GCE node
W20260811 07:27:01.424585 13472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:01.425628 13465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:01.427551 13465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:01.435051 13465 hybrid_clock.cc:648] HybridClock initialized: now 1786433221434943 us; error 120 us; skew 500 ppm
Aug 11 07:27:01 dist-test-slave-77v9 krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:01.439311 13465 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:01.440532 13465 webserver.cc:460] Webserver started at http://127.11.248.62:33979/ using document root <none> and password file <none>
I20260811 07:27:01.441447 13465 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:01.441574 13465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:01.441846 13465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:01.444666 13465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d"
format_stamp: "Formatted at 2026-08-11 07:27:01 on dist-test-slave-77v9"
server_key: "000ea313d04484bb1fe61b6a6157f259"
server_key_iv: "3f92a96ab0915d4f2aebf18f91da85e6"
server_key_version: "encryptionkey@0"
I20260811 07:27:01.445688 13465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d"
format_stamp: "Formatted at 2026-08-11 07:27:01 on dist-test-slave-77v9"
server_key: "000ea313d04484bb1fe61b6a6157f259"
server_key_iv: "3f92a96ab0915d4f2aebf18f91da85e6"
server_key_version: "encryptionkey@0"
I20260811 07:27:01.450909 13465 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:27:01.454489 13482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:01.456099 13465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:27:01.456261 13465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d"
format_stamp: "Formatted at 2026-08-11 07:27:01 on dist-test-slave-77v9"
server_key: "000ea313d04484bb1fe61b6a6157f259"
server_key_iv: "3f92a96ab0915d4f2aebf18f91da85e6"
server_key_version: "encryptionkey@0"
I20260811 07:27:01.456437 13465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:01.505839 13465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:01.509204 13465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:01.509459 13465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:01.518690 13465 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:36509
I20260811 07:27:01.518754 13549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:36509 every 8 connection(s)
I20260811 07:27:01.519798 13465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:01.522994 13550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:01.524150 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 13465
I20260811 07:27:01.524274 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:01.524600 12256 external_mini_cluster.cc:1428] Setting key 2a248939fa6eae9135cc31404b7dd873
I20260811 07:27:01.530094 13550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: Bootstrap starting.
I20260811 07:27:01.532768 13550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:01.533725 13550 log.cc:824] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:27:01 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:01.536330 13550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: No bootstrap required, opened a new log
I20260811 07:27:01.540463 13550 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36509 } }
I20260811 07:27:01.540768 13550 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:01.540858 13550 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6afb5c4ef34a73b3e7b70968d86b8d, State: Initialized, Role: FOLLOWER
I20260811 07:27:01.541352 13550 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36509 } }
I20260811 07:27:01.541512 13550 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:01.541605 13550 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:01.541631 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:01.526289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52550 (local address 127.11.248.62:36509)
0811 07:27:01.526829 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:01.526845 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:01.526882 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:27:01.527553 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:01.527570 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:01.527906 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:01.528257 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:01.529177 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.530338 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.531327 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.531849 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.532040 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:01.535212 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:01.535219 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:01.535236 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:01.535273 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:01.538002 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:01.538656 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:01.538662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:01.538667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:01.538807 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:01.539165 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:01.539168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:01.539169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:01.539649 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:01.539826 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:01.540164 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 07:27:01.540580 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":195,"threads_started":1}
I20260811 07:27:01.541738 13550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:01.542858 13550 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36509 } }
I20260811 07:27:01.543236 13550 leader_election.cc:302] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe6afb5c4ef34a73b3e7b70968d86b8d; no voters:
I20260811 07:27:01.543648 13550 leader_election.cc:288] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:01.543897 13556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:01.544191 13556 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [term 1 LEADER]: Becoming Leader. State: Replica: fe6afb5c4ef34a73b3e7b70968d86b8d, State: Running, Role: LEADER
I20260811 07:27:01.544512 13556 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36509 } }
I20260811 07:27:01.545047 13550 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:01.545787 13558 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe6afb5c4ef34a73b3e7b70968d86b8d. Latest consensus state: current_term: 1 leader_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36509 } } }
I20260811 07:27:01.545941 13558 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:01.546320 13557 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe6afb5c4ef34a73b3e7b70968d86b8d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36509 } } }
I20260811 07:27:01.546432 13557 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:01.546558 13566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:01.549978 13566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:01.557056 13566 catalog_manager.cc:1347] Generated new cluster ID: f634f748b99e490888c8fb64afbbdd40
I20260811 07:27:01.557168 13566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:01.584314 13566 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:01.585497 13566 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:01.591835 13566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: Generated new TSK 0
I20260811 07:27:01.592892 13566 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:01.641959 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36509
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:01.775846 13580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:01.776163 13580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:01.776211 13580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:01.780617 13580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:01.780701 13580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:01.780745 13580 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:01.780839 13580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:01.786886 13580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:36509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:01.788177 13580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:01.789570 13580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:01.800550 13591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:01.800550 13588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:01.800846 13589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:01.800984 13580 server_base.cc:1034] running on GCE node
I20260811 07:27:01.801455 13580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:01.802145 13580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:01.803364 13580 hybrid_clock.cc:648] HybridClock initialized: now 1786433221803348 us; error 39 us; skew 500 ppm
Aug 11 07:27:01 dist-test-slave-77v9 krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:01.806511 13580 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:01.807511 13580 webserver.cc:460] Webserver started at http://127.11.248.1:39037/ using document root <none> and password file <none>
I20260811 07:27:01.808122 13580 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:01.808220 13580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:01.808473 13580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:01.810775 13580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "4d82de86855e4ffab9dbc9bd1f193689"
format_stamp: "Formatted at 2026-08-11 07:27:01 on dist-test-slave-77v9"
server_key: "868a85842f4cb74a8c5976328bcd2ad5"
server_key_iv: "f513f9358c20803eb836763723f9081b"
server_key_version: "encryptionkey@0"
I20260811 07:27:01.811473 13580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "4d82de86855e4ffab9dbc9bd1f193689"
format_stamp: "Formatted at 2026-08-11 07:27:01 on dist-test-slave-77v9"
server_key: "868a85842f4cb74a8c5976328bcd2ad5"
server_key_iv: "f513f9358c20803eb836763723f9081b"
server_key_version: "encryptionkey@0"
I20260811 07:27:01.815578 13580 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:01.818286 13599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:01.819715 13580 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:27:01.819890 13580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "4d82de86855e4ffab9dbc9bd1f193689"
format_stamp: "Formatted at 2026-08-11 07:27:01 on dist-test-slave-77v9"
server_key: "868a85842f4cb74a8c5976328bcd2ad5"
server_key_iv: "f513f9358c20803eb836763723f9081b"
server_key_version: "encryptionkey@0"
I20260811 07:27:01.820052 13580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:01.833411 13580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:01.837234 13580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:01.837497 13580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:01.839205 13580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:01.839308 13580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:01.839382 13580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:01.839438 13580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:01 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:01.851471 13580 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:35059
I20260811 07:27:01.851635 13722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:35059 every 8 connection(s)
I20260811 07:27:01.852757 13580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:01.855121 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:01.840115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:34309 (local address 127.11.248.62:36509)
0811 07:27:01.840275 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:01.840280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:01.841356 (+ 1076us) server_negotiation.cc:407] Connection header received
0811 07:27:01.842316 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:01.842319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:01.842389 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:01.842505 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:01.844143 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.845111 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.846541 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.846803 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.846935 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:01.850810 (+ 3875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:01.850814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:01.850817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:01.850867 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:01.852743 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:01.853411 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:01.853415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:01.853417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:01.853524 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:01.853903 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:01.853906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:01.853907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:01.854112 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:01.854205 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:01.854869 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 07:27:01.854995 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:27:01.856117 13609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:01.840549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.11.248.1:34309)
0811 07:27:01.841164 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:01.841217 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:01.842083 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:01.842800 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:01.842809 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:01.843367 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:01.843960 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:01.843975 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.845264 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.845268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:01.846384 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:01.846395 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.847003 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.847008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:01.847261 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:01.848007 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:01.848025 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:01.850564 (+ 2539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:01.852943 (+ 2379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:01.852949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:01.852969 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:01.853243 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:01.853644 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:01.853647 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:01.853650 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:01.853821 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:01.854255 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:01.854271 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:01.854543 (+ 272us) client_negotiation.cc:769] Sending connection context
0811 07:27:01.854822 (+ 279us) client_negotiation.cc:240] Negotiation successful
0811 07:27:01.855143 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":142,"threads_started":1}
I20260811 07:27:01.857672 13724 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36509
I20260811 07:27:01.857851 13724 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:01.858381 13724 heartbeater.cc:511] Master 127.11.248.62:36509 requested a full tablet report, sending...
I20260811 07:27:01.860257 13499 ts_manager.cc:194] Registered new tserver with Master: 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059)
I20260811 07:27:01.861547 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 13580
I20260811 07:27:01.861683 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:01.861878 13499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:34309
I20260811 07:27:01.862094 12256 external_mini_cluster.cc:1428] Setting key aca0afae05669d60a6735c18a1e700ff
I20260811 07:27:01.869412 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:01.860137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.11.248.1:49637)
0811 07:27:01.861027 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:01.861044 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:01.861155 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:01.861687 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:01.861692 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:01.861953 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:01.862096 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:01.862106 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.863175 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.863177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:01.863836 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:01.863848 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.864332 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.864335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:01.864435 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:01.865081 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:01.865093 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:01.865469 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:01.867694 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:01.867697 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:01.867699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:01.867950 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:01.868281 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:01.868283 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:01.868284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:01.868363 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:01.868898 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:01.868900 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:01.869018 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 07:27:01.869106 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:27:01.869237 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"thread_start_us":140,"threads_started":1}
I20260811 07:27:01.869632 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:01.860274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49637 (local address 127.11.248.62:36509)
0811 07:27:01.860441 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:01.860446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:01.861131 (+ 685us) server_negotiation.cc:407] Connection header received
0811 07:27:01.861274 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:01.861277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:01.861333 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:01.861466 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:01.862250 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.863002 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.863968 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:01.864206 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:01.864324 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:01.865620 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:01.865623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:01.865626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:01.865651 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:01.867550 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:01.868064 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:01.868070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:01.868075 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:01.868180 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:01.868455 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:01.868461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:01.868465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:01.868741 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:01.868898 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:01.869206 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 07:27:01.869381 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:01.897456 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36509
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:02.018235 13734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:02.018565 13734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:02.018613 13734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:02.023015 13734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:02.023093 13734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:02.023135 13734 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:02.023209 13734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:02.029137 13734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:36509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:02.030344 13734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:02.031457 13734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:02.041886 13742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:02.041868 13740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:02.041868 13745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:02.042910 13734 server_base.cc:1034] running on GCE node
I20260811 07:27:02.043449 13734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:02.044286 13734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:02.045513 13734 hybrid_clock.cc:648] HybridClock initialized: now 1786433222045489 us; error 37 us; skew 500 ppm
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:02.049099 13734 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:02.050156 13734 webserver.cc:460] Webserver started at http://127.11.248.2:35943/ using document root <none> and password file <none>
I20260811 07:27:02.050868 13734 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:02.050985 13734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:02.051245 13734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:02.053579 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "b45a0e7d714546d38a693e8e1c5a52d9"
format_stamp: "Formatted at 2026-08-11 07:27:02 on dist-test-slave-77v9"
server_key: "7c68ecb291954cb67025136db6d881b0"
server_key_iv: "67503bf1720abcc3ab8b7c9add6b5733"
server_key_version: "encryptionkey@0"
I20260811 07:27:02.054193 13734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "b45a0e7d714546d38a693e8e1c5a52d9"
format_stamp: "Formatted at 2026-08-11 07:27:02 on dist-test-slave-77v9"
server_key: "7c68ecb291954cb67025136db6d881b0"
server_key_iv: "67503bf1720abcc3ab8b7c9add6b5733"
server_key_version: "encryptionkey@0"
I20260811 07:27:02.058493 13734 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:02.061415 13752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:02.062772 13734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:02.062925 13734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "b45a0e7d714546d38a693e8e1c5a52d9"
format_stamp: "Formatted at 2026-08-11 07:27:02 on dist-test-slave-77v9"
server_key: "7c68ecb291954cb67025136db6d881b0"
server_key_iv: "67503bf1720abcc3ab8b7c9add6b5733"
server_key_version: "encryptionkey@0"
I20260811 07:27:02.063055 13734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:02.097308 13734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:02.101083 13734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:02.101327 13734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:02.102926 13734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:02.103004 13734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:02.103077 13734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:02.103125 13734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:02.115092 13734 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:40401
I20260811 07:27:02.115365 13880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:40401 every 8 connection(s)
I20260811 07:27:02.116396 13734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:02.118600 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.104003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:45975 (local address 127.11.248.62:36509)
0811 07:27:02.104148 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.104152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.105243 (+ 1091us) server_negotiation.cc:407] Connection header received
0811 07:27:02.106329 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.106336 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.106409 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.106498 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:02.108155 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.109140 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.110816 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.111230 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.111367 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.114255 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:02.114260 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:02.114263 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:02.114299 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:02.116224 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.116912 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.116917 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.116919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.117029 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.117436 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.117440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.117441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.117648 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:02.117763 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.118272 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.118421 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:27:02.119385 13761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.104533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.11.248.2:45975)
0811 07:27:02.105082 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.105126 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.106068 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.106906 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.106913 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.107304 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:02.107969 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.107990 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.109296 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.109302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.110696 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.110707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.111456 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.111463 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.111699 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.112414 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:02.112448 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:02.114059 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:02.116366 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.116375 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.116392 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.116762 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.117141 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.117144 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.117146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.117315 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.117760 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:02.117766 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:02.118028 (+ 262us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.118213 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.118560 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":207,"threads_started":1}
I20260811 07:27:02.120867 13881 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36509
I20260811 07:27:02.121031 13881 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:02.121663 13881 heartbeater.cc:511] Master 127.11.248.62:36509 requested a full tablet report, sending...
I20260811 07:27:02.122975 13500 ts_manager.cc:194] Registered new tserver with Master: b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401)
I20260811 07:27:02.123864 13500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:45975
I20260811 07:27:02.126686 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 13734
I20260811 07:27:02.126801 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:02.127090 12256 external_mini_cluster.cc:1428] Setting key 5642c698bbbf669c5a0f39479cf2ab9a
I20260811 07:27:02.132721 13889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.123654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.11.248.2:45743)
0811 07:27:02.124079 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.124091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.124210 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.124455 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.124458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.124843 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:02.124975 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.124981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.126082 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.126085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.126819 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.126831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.127331 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.127335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.127426 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.128359 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:02.128370 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:02.128902 (+ 532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:02.130779 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.130785 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.130791 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.131099 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.131548 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.131551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.131552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.131647 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.132223 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:02.132225 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:02.132322 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.132417 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.132564 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":119,"threads_started":1}
I20260811 07:27:02.132776 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.123727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:45743 (local address 127.11.248.62:36509)
0811 07:27:02.123871 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.123877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.124190 (+ 313us) server_negotiation.cc:407] Connection header received
0811 07:27:02.124299 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.124302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.124341 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.124417 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:02.125095 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.125953 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.126939 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.127171 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.127305 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.129036 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:02.129038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:02.129040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:02.129062 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:02.130651 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.131274 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.131281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.131285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.131395 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.131751 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.131758 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.131760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.132107 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:02.132217 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.132507 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.132647 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:02.160980 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36509
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:02.283996 13893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:02.284323 13893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:02.284372 13893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:02.288666 13893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:02.288764 13893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:02.288898 13893 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:02.288954 13893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:02.294723 13893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:36509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:02.295871 13893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:02.296985 13893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:02.307224 13898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:02.307216 13902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:02.307216 13900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:02.307475 13893 server_base.cc:1034] running on GCE node
I20260811 07:27:02.308014 13893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:02.308712 13893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:02.309965 13893 hybrid_clock.cc:648] HybridClock initialized: now 1786433222309948 us; error 32 us; skew 500 ppm
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:02.313169 13893 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:02.314191 13893 webserver.cc:460] Webserver started at http://127.11.248.3:38335/ using document root <none> and password file <none>
I20260811 07:27:02.314793 13893 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:02.314899 13893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:02.315157 13893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:02.317371 13893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "b5f046845df1498bb45d7d6055d166de"
format_stamp: "Formatted at 2026-08-11 07:27:02 on dist-test-slave-77v9"
server_key: "abe610c3840c9e52245986c4de2f299f"
server_key_iv: "8c91668d32f7fe157c7d6ad936aa068f"
server_key_version: "encryptionkey@0"
I20260811 07:27:02.317991 13893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "b5f046845df1498bb45d7d6055d166de"
format_stamp: "Formatted at 2026-08-11 07:27:02 on dist-test-slave-77v9"
server_key: "abe610c3840c9e52245986c4de2f299f"
server_key_iv: "8c91668d32f7fe157c7d6ad936aa068f"
server_key_version: "encryptionkey@0"
I20260811 07:27:02.322459 13893 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:02.325429 13909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:02.326777 13893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:02.326998 13893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "b5f046845df1498bb45d7d6055d166de"
format_stamp: "Formatted at 2026-08-11 07:27:02 on dist-test-slave-77v9"
server_key: "abe610c3840c9e52245986c4de2f299f"
server_key_iv: "8c91668d32f7fe157c7d6ad936aa068f"
server_key_version: "encryptionkey@0"
I20260811 07:27:02.327128 13893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:02.340566 13893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:02.344341 13893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:02.344599 13893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:02.346437 13893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:02.346535 13893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:02.346602 13893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:02.346655 13893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:02.362586 13893 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:34269
I20260811 07:27:02.362619 14041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:34269 every 8 connection(s)
I20260811 07:27:02.363978 13893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:02.364763 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.347664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:50511 (local address 127.11.248.62:36509)
0811 07:27:02.347823 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.347828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.349116 (+ 1288us) server_negotiation.cc:407] Connection header received
0811 07:27:02.350596 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.350604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.350669 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.350727 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:02.352211 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.352986 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.354513 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.355065 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.355257 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.359541 (+ 4284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:02.359549 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:02.359556 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:02.359601 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:02.361979 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.362703 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.362707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.362709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.362829 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.363321 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.363325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.363327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.363625 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:02.363757 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.364381 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.364553 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:27:02.365768 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.348283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.11.248.3:50511)
0811 07:27:02.348933 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.349000 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.350309 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.351085 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.351092 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.351471 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:02.352030 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.352045 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.353126 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.353130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.354348 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.354361 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.355337 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.355344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.355572 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.356293 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:02.356312 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:02.359238 (+ 2926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:02.362151 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.362159 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.362177 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.362592 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.362942 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.362945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.362946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.363209 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.363780 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:02.363786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:02.364093 (+ 307us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.364297 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.364658 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":162,"threads_started":1}
I20260811 07:27:02.367506 14042 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36509
I20260811 07:27:02.367666 14042 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:02.368502 14042 heartbeater.cc:511] Master 127.11.248.62:36509 requested a full tablet report, sending...
I20260811 07:27:02.369939 13499 ts_manager.cc:194] Registered new tserver with Master: b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269)
I20260811 07:27:02.370800 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 13893
I20260811 07:27:02.370898 13499 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:50511
I20260811 07:27:02.370965 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:02.371311 12256 external_mini_cluster.cc:1428] Setting key 81cc3ae9ae26b4780e73aceef40503b5
I20260811 07:27:02.373917 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:27:02.379074 14049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.370230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.11.248.3:59729)
0811 07:27:02.370555 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.370573 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.370682 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.371097 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.371100 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.371379 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:02.371535 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.371545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.372595 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.372601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.373412 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.373422 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.373995 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.373999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.374095 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.374685 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:02.374696 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:02.375083 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:02.377287 (+ 2204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.377290 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.377292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.377525 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.377911 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.377913 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.377914 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.378006 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.378559 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:02.378562 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:02.378652 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.378756 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.378893 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":138,"threads_started":1}
I20260811 07:27:02.379271 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.370298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:59729 (local address 127.11.248.62:36509)
0811 07:27:02.370455 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.370460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.370664 (+ 204us) server_negotiation.cc:407] Connection header received
0811 07:27:02.370771 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.370777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.370835 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.370940 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:02.371813 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.372412 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.373541 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.373864 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.373993 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.375228 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:02.375232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:02.375234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:02.375271 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:02.377136 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.377641 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.377648 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.377653 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.377779 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.378116 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.378123 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.378128 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.378438 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:02.378558 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.378857 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.379016 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:02.406181 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.397045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52560 (local address 127.11.248.62:36509)
0811 07:27:02.397183 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.397186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.397200 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:27:02.397244 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.397246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.397288 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.397357 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:02.398180 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.398752 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.399629 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.399846 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.399941 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.402878 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:02.402883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:02.402885 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:02.402919 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:02.404517 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.405092 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.405095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.405096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.405189 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.405441 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.405443 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.405444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.405638 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:02.405745 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.405943 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.406052 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:27:02.409689 13499 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:02.413130 13499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:02.429402 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.422727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.11.248.1:35059)
0811 07:27:02.423865 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.423872 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.423899 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:27:02.424018 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.424024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.424272 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.424451 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.425055 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.426073 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.427669 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.428528 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.428648 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.428833 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.429119 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.429233 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1032,"thread_start_us":110,"threads_started":1}
I20260811 07:27:02.429416 14066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.423575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40401 (local address 127.0.0.1:55396)
0811 07:27:02.424530 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.424543 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.424639 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.425472 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.425475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.425494 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.425574 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.425579 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.426950 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.426953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.428009 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.428017 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.428969 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.428972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.429060 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.429087 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.429153 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.429238 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"mutex_wait_us":5,"thread_start_us":99,"threads_started":1}
I20260811 07:27:02.429433 14067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.424134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.11.248.2:40401)
0811 07:27:02.424999 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.425013 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.425035 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:27:02.425119 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.425123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.425315 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.425477 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.425691 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.426806 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.428131 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.428764 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.428965 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.429136 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.429189 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.429283 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":126,"threads_started":1}
I20260811 07:27:02.429940 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.422719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:34269 (local address 127.0.0.1:53504)
0811 07:27:02.423786 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.423800 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.423927 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.424639 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.424645 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.424681 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.424945 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.424953 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.426467 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.426471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.427686 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.427696 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.429508 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.429515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.429636 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.429672 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.429754 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.429814 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"mutex_wait_us":9,"spinlock_wait_cycles":3840,"thread_start_us":142,"threads_started":1}
I20260811 07:27:02.429447 14063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.422598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:35059 (local address 127.0.0.1:33534)
0811 07:27:02.423299 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.423357 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.423563 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.424641 (+ 1078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.424647 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.424684 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.424936 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.424942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.426184 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.426191 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.427540 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.427549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.428671 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.428675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.428791 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.428932 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.429067 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.429235 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":93,"spinlock_wait_cycles":8832,"thread_start_us":230,"threads_started":1}
I20260811 07:27:02.430433 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.423152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53504 (local address 127.11.248.3:34269)
0811 07:27:02.423549 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.423562 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.423913 (+ 351us) server_negotiation.cc:407] Connection header received
0811 07:27:02.424047 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.424052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.424275 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.424450 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.425097 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.426306 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.427816 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.428535 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.428648 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.428855 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.429814 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.430270 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":111,"threads_started":1}
I20260811 07:27:02.433176 13966 tablet_service.cc:1467] Processing CreateTablet for tablet 8e13583db5774cb9afd746d7a4c50b98 (DEFAULT_TABLE table=test-table [id=88f0e90b66764b12a75e4df093836f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:02.433177 13804 tablet_service.cc:1467] Processing CreateTablet for tablet 8e13583db5774cb9afd746d7a4c50b98 (DEFAULT_TABLE table=test-table [id=88f0e90b66764b12a75e4df093836f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:02.433177 13651 tablet_service.cc:1467] Processing CreateTablet for tablet 8e13583db5774cb9afd746d7a4c50b98 (DEFAULT_TABLE table=test-table [id=88f0e90b66764b12a75e4df093836f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:02.434294 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e13583db5774cb9afd746d7a4c50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.434294 13804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e13583db5774cb9afd746d7a4c50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.434314 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e13583db5774cb9afd746d7a4c50b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.441783 14068 tablet_bootstrap.cc:492] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Bootstrap starting.
I20260811 07:27:02.443401 14069 tablet_bootstrap.cc:492] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Bootstrap starting.
I20260811 07:27:02.443401 14070 tablet_bootstrap.cc:492] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Bootstrap starting.
I20260811 07:27:02.444200 14068 tablet_bootstrap.cc:654] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.445132 14068 log.cc:824] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:02.445787 14070 tablet_bootstrap.cc:654] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.446106 14069 tablet_bootstrap.cc:654] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.446758 14070 log.cc:824] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:02.447340 14069 log.cc:824] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:02.447680 14068 tablet_bootstrap.cc:492] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: No bootstrap required, opened a new log
I20260811 07:27:02.447897 14068 ts_tablet_manager.cc:1397] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:27:02.449083 14070 tablet_bootstrap.cc:492] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: No bootstrap required, opened a new log
I20260811 07:27:02.449245 14070 ts_tablet_manager.cc:1397] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260811 07:27:02.449457 14069 tablet_bootstrap.cc:492] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: No bootstrap required, opened a new log
I20260811 07:27:02.449632 14069 ts_tablet_manager.cc:1397] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:27:02.452287 14070 raft_consensus.cc:348] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.452301 14068 raft_consensus.cc:348] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.452598 14070 raft_consensus.cc:374] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.452605 14068 raft_consensus.cc:374] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.452657 14070 raft_consensus.cc:729] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45a0e7d714546d38a693e8e1c5a52d9, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.452657 14068 raft_consensus.cc:729] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f046845df1498bb45d7d6055d166de, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.453219 14068 consensus_queue.cc:260] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.453219 14070 consensus_queue.cc:260] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.454406 14070 ts_tablet_manager.cc:1428] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260811 07:27:02.454398 14068 ts_tablet_manager.cc:1428] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 07:27:02.454754 13881 heartbeater.cc:503] Master 127.11.248.62:36509 was elected leader, sending a full tablet report...
I20260811 07:27:02.454779 14042 heartbeater.cc:503] Master 127.11.248.62:36509 was elected leader, sending a full tablet report...
I20260811 07:27:02.454619 14069 raft_consensus.cc:348] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.454916 14069 raft_consensus.cc:374] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.454995 14069 raft_consensus.cc:729] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d82de86855e4ffab9dbc9bd1f193689, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.455451 14069 consensus_queue.cc:260] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.456193 13724 heartbeater.cc:503] Master 127.11.248.62:36509 was elected leader, sending a full tablet report...
I20260811 07:27:02.457593 14069 ts_tablet_manager.cc:1428] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260811 07:27:02.604486 13726 tablet.cc:2369] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:02.612097 14077 raft_consensus.cc:482] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:02.612370 14077 raft_consensus.cc:504] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.613965 14077 leader_election.cc:288] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269), b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401)
W20260811 07:27:02.615494 14043 tablet.cc:2369] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:27:02.617686 13882 tablet.cc:2369] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:02.619501 14067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.614508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:45423 (local address 127.11.248.2:40401)
0811 07:27:02.614649 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.614653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.615026 (+ 373us) server_negotiation.cc:407] Connection header received
0811 07:27:02.615119 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.615122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.615167 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.615249 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.615591 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.616342 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.618099 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.618729 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.618863 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.618939 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.619291 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.619369 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:27:02.619501 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.614374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:51605 (local address 127.11.248.3:34269)
0811 07:27:02.614524 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.614529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.614727 (+ 198us) server_negotiation.cc:407] Connection header received
0811 07:27:02.614879 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.614883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.614948 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.615036 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.615396 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.616286 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.618262 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.618856 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.619020 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.619056 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.619289 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.619369 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:27:02.619591 14080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.614191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40401 (local address 127.11.248.1:45423)
0811 07:27:02.614901 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.614915 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.615032 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.615327 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.615330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.615348 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.615462 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.615468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.616439 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.616441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.617957 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.617963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.618941 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.618948 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.619066 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.619179 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.619264 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.619390 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":560,"thread_start_us":128,"threads_started":1}
I20260811 07:27:02.619594 14078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.614191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:34269 (local address 127.11.248.1:51605)
0811 07:27:02.614608 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.614626 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.614758 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.615066 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.615069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.615095 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.615239 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.615247 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.616433 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.616437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.617949 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.617963 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.618988 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.618991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.619116 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.619176 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.619271 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.619390 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":100,"thread_start_us":134,"threads_started":1}
I20260811 07:27:02.620386 13991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e13583db5774cb9afd746d7a4c50b98" candidate_uuid: "4d82de86855e4ffab9dbc9bd1f193689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f046845df1498bb45d7d6055d166de" is_pre_election: true
I20260811 07:27:02.620479 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e13583db5774cb9afd746d7a4c50b98" candidate_uuid: "4d82de86855e4ffab9dbc9bd1f193689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" is_pre_election: true
I20260811 07:27:02.620734 13991 raft_consensus.cc:2454] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d82de86855e4ffab9dbc9bd1f193689 in term 0.
I20260811 07:27:02.620759 13827 raft_consensus.cc:2454] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d82de86855e4ffab9dbc9bd1f193689 in term 0.
I20260811 07:27:02.621383 13601 leader_election.cc:302] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4d82de86855e4ffab9dbc9bd1f193689, b45a0e7d714546d38a693e8e1c5a52d9, b5f046845df1498bb45d7d6055d166de; no voters:
I20260811 07:27:02.621707 14077 raft_consensus.cc:2781] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:02.621816 14077 raft_consensus.cc:482] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:02.621879 14077 raft_consensus.cc:3037] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.623054 14077 raft_consensus.cc:504] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.623446 14077 leader_election.cc:288] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [CANDIDATE]: Term 1 election: Requested vote from peers b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269), b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401)
I20260811 07:27:02.623816 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e13583db5774cb9afd746d7a4c50b98" candidate_uuid: "4d82de86855e4ffab9dbc9bd1f193689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45a0e7d714546d38a693e8e1c5a52d9"
I20260811 07:27:02.623819 13991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e13583db5774cb9afd746d7a4c50b98" candidate_uuid: "4d82de86855e4ffab9dbc9bd1f193689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f046845df1498bb45d7d6055d166de"
I20260811 07:27:02.623972 13827 raft_consensus.cc:3037] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.623981 13991 raft_consensus.cc:3037] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.625339 13827 raft_consensus.cc:2454] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d82de86855e4ffab9dbc9bd1f193689 in term 1.
I20260811 07:27:02.625769 13603 leader_election.cc:302] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d82de86855e4ffab9dbc9bd1f193689, b45a0e7d714546d38a693e8e1c5a52d9; no voters:
I20260811 07:27:02.625929 13991 raft_consensus.cc:2454] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d82de86855e4ffab9dbc9bd1f193689 in term 1.
I20260811 07:27:02.625981 14077 raft_consensus.cc:2781] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:02.626212 14077 raft_consensus.cc:686] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 LEADER]: Becoming Leader. State: Replica: 4d82de86855e4ffab9dbc9bd1f193689, State: Running, Role: LEADER
I20260811 07:27:02.626583 14077 consensus_queue.cc:237] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } }
I20260811 07:27:02.630077 13498 catalog_manager.cc:5495] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1). New cstate: current_term: 1 leader_uuid: "4d82de86855e4ffab9dbc9bd1f193689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } health_report { overall_health: UNKNOWN } } }
I20260811 07:27:02.676745 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.672295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33544 (local address 127.11.248.1:35059)
0811 07:27:02.672458 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.672462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.672479 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:27:02.672589 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.672592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.672650 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.672761 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:02.673244 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.673828 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.675053 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.675298 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.675393 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.675789 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:02.676303 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:02.676398 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.676558 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.676623 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:27:02.683357 13827 raft_consensus.cc:1261] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Refusing update from remote peer 4d82de86855e4ffab9dbc9bd1f193689: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:02.683431 13991 raft_consensus.cc:1261] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Refusing update from remote peer 4d82de86855e4ffab9dbc9bd1f193689: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:02.684170 14081 consensus_queue.cc:1035] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:02.684410 14077 consensus_queue.cc:1035] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:02.692695 14087 mvcc.cc:205] Tried to move back new op lower bound from 7317230480102477824 to 7317230479881383936. Current Snapshot: MvccSnapshot[applied={T|T < 7317230480102477824}]
I20260811 07:27:02.707244 13499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:02.707489 13499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:02.710605 13499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: Sending DeleteTablet for 3 replicas of tablet 8e13583db5774cb9afd746d7a4c50b98
I20260811 07:27:02.711582 13966 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e13583db5774cb9afd746d7a4c50b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:02 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:53504
I20260811 07:27:02.711598 13651 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e13583db5774cb9afd746d7a4c50b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:02 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:33534
I20260811 07:27:02.711699 13804 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e13583db5774cb9afd746d7a4c50b98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:02 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:55396
I20260811 07:27:02.712342 14099 tablet_replica.cc:330] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: stopping tablet replica
I20260811 07:27:02.712486 14101 tablet_replica.cc:330] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: stopping tablet replica
I20260811 07:27:02.712858 14099 raft_consensus.cc:2229] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:02.712858 14101 raft_consensus.cc:2229] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:02.712764 13499 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52560:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:27:02.713214 14101 raft_consensus.cc:2258] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 07:27:02.713267 13499 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:02.713621 14102 tablet_replica.cc:330] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: stopping tablet replica
I20260811 07:27:02.713866 14099 raft_consensus.cc:2258] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:02.713932 14102 raft_consensus.cc:2229] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:02.714224 14102 raft_consensus.cc:2258] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:02.715893 14101 ts_tablet_manager.cc:1905] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:02.716408 14099 ts_tablet_manager.cc:1905] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:02.719265 14101 ts_tablet_manager.cc:1918] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:02.719386 14101 log.cc:1196] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/8e13583db5774cb9afd746d7a4c50b98
I20260811 07:27:02.719375 14099 ts_tablet_manager.cc:1918] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:02.719496 14099 log.cc:1196] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/8e13583db5774cb9afd746d7a4c50b98
I20260811 07:27:02.719467 13651 tablet_service.cc:1467] Processing CreateTablet for tablet e1fa320eef34475b9e15a4812a4ae7d4 (DEFAULT_TABLE table=test-table [id=1184bae017c34da7921773987f0f982a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:02.719710 14101 ts_tablet_manager.cc:1939] T 8e13583db5774cb9afd746d7a4c50b98 P b5f046845df1498bb45d7d6055d166de: Deleting consensus metadata
I20260811 07:27:02.719790 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1fa320eef34475b9e15a4812a4ae7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.719837 14099 ts_tablet_manager.cc:1939] T 8e13583db5774cb9afd746d7a4c50b98 P 4d82de86855e4ffab9dbc9bd1f193689: Deleting consensus metadata
I20260811 07:27:02.721089 13486 catalog_manager.cc:4841] TS 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059): tablet 8e13583db5774cb9afd746d7a4c50b98 (table test-table [id=88f0e90b66764b12a75e4df093836f89]) successfully deleted
I20260811 07:27:02.721757 13804 tablet_service.cc:1467] Processing CreateTablet for tablet e1fa320eef34475b9e15a4812a4ae7d4 (DEFAULT_TABLE table=test-table [id=1184bae017c34da7921773987f0f982a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:02.721835 13966 tablet_service.cc:1467] Processing CreateTablet for tablet e1fa320eef34475b9e15a4812a4ae7d4 (DEFAULT_TABLE table=test-table [id=1184bae017c34da7921773987f0f982a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:02.721980 13484 catalog_manager.cc:4841] TS b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269): tablet 8e13583db5774cb9afd746d7a4c50b98 (table test-table [id=88f0e90b66764b12a75e4df093836f89]) successfully deleted
I20260811 07:27:02.722064 13804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1fa320eef34475b9e15a4812a4ae7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.722074 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1fa320eef34475b9e15a4812a4ae7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.722239 14069 tablet_bootstrap.cc:492] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Bootstrap starting.
I20260811 07:27:02.723095 14069 tablet_bootstrap.cc:654] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.724306 14069 tablet_bootstrap.cc:492] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: No bootstrap required, opened a new log
I20260811 07:27:02.724402 14069 ts_tablet_manager.cc:1397] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:02.724500 14068 tablet_bootstrap.cc:492] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Bootstrap starting.
I20260811 07:27:02.724931 14069 raft_consensus.cc:348] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.725051 14069 raft_consensus.cc:374] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.725055 14070 tablet_bootstrap.cc:492] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Bootstrap starting.
I20260811 07:27:02.725082 14069 raft_consensus.cc:729] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d82de86855e4ffab9dbc9bd1f193689, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.725199 14069 consensus_queue.cc:260] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.725445 14069 ts_tablet_manager.cc:1428] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:02.726157 14070 tablet_bootstrap.cc:654] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.726182 14068 tablet_bootstrap.cc:654] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.728749 14102 ts_tablet_manager.cc:1905] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:02.728886 14070 tablet_bootstrap.cc:492] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: No bootstrap required, opened a new log
I20260811 07:27:02.728976 14070 ts_tablet_manager.cc:1397] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260811 07:27:02.730130 14070 raft_consensus.cc:348] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.730263 14070 raft_consensus.cc:374] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.730310 14070 raft_consensus.cc:729] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45a0e7d714546d38a693e8e1c5a52d9, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.730476 14070 consensus_queue.cc:260] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.732409 14070 ts_tablet_manager.cc:1428] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:02.732388 14102 ts_tablet_manager.cc:1918] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:02.732946 14102 log.cc:1196] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/8e13583db5774cb9afd746d7a4c50b98
I20260811 07:27:02.733350 14102 ts_tablet_manager.cc:1939] T 8e13583db5774cb9afd746d7a4c50b98 P b45a0e7d714546d38a693e8e1c5a52d9: Deleting consensus metadata
I20260811 07:27:02.733397 14068 tablet_bootstrap.cc:492] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: No bootstrap required, opened a new log
I20260811 07:27:02.733493 14068 ts_tablet_manager.cc:1397] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260811 07:27:02.733983 14068 raft_consensus.cc:348] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.734099 14068 raft_consensus.cc:374] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.734130 14068 raft_consensus.cc:729] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f046845df1498bb45d7d6055d166de, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.734251 14068 consensus_queue.cc:260] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.734494 14068 ts_tablet_manager.cc:1428] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:02.734848 13486 catalog_manager.cc:4841] TS b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401): tablet 8e13583db5774cb9afd746d7a4c50b98 (table test-table [id=88f0e90b66764b12a75e4df093836f89]) successfully deleted
I20260811 07:27:02.769454 14076 raft_consensus.cc:482] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:02.769646 14076 raft_consensus.cc:504] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.770776 14076 leader_election.cc:288] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059), b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401)
I20260811 07:27:02.776324 14106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.771308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40401 (local address 127.11.248.3:44821)
0811 07:27:02.771611 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.771624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.771707 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.772292 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.772295 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.772314 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.772428 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.772437 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.773338 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.773341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.774727 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.774733 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.775872 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.775874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.775951 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.775973 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.776066 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.776145 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":40,"thread_start_us":90,"threads_started":1}
I20260811 07:27:02.776294 14067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.771716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44821 (local address 127.11.248.2:40401)
0811 07:27:02.771983 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.771987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.772004 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:27:02.772056 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.772062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.772118 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.772187 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.772568 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.773204 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.774921 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.775715 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.775860 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.775916 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.776088 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.776168 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:27:02.777148 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1fa320eef34475b9e15a4812a4ae7d4" candidate_uuid: "b5f046845df1498bb45d7d6055d166de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" is_pre_election: true
I20260811 07:27:02.777241 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.771070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:35059 (local address 127.11.248.3:44371)
0811 07:27:02.771246 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.771262 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.771381 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.771744 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.771750 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.771767 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.771990 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.772000 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.773179 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.773182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.774721 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.774733 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.776724 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.776728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.776874 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.776903 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.777030 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.777111 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":64}
I20260811 07:27:02.777292 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.771260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44371 (local address 127.11.248.1:35059)
0811 07:27:02.771394 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.771398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.771417 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:27:02.771492 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.771495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.771542 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.771616 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.772175 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.773056 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.775985 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.776597 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.776790 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.776951 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.777074 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.777163 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:27:02.777323 13827 raft_consensus.cc:2454] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f046845df1498bb45d7d6055d166de in term 0.
I20260811 07:27:02.777794 13913 leader_election.cc:302] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45a0e7d714546d38a693e8e1c5a52d9, b5f046845df1498bb45d7d6055d166de; no voters:
I20260811 07:27:02.777956 13673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1fa320eef34475b9e15a4812a4ae7d4" candidate_uuid: "b5f046845df1498bb45d7d6055d166de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d82de86855e4ffab9dbc9bd1f193689" is_pre_election: true
I20260811 07:27:02.778160 14076 raft_consensus.cc:2781] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:02.778223 14076 raft_consensus.cc:482] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:02.778198 13673 raft_consensus.cc:2454] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5f046845df1498bb45d7d6055d166de in term 0.
I20260811 07:27:02.778261 14076 raft_consensus.cc:3037] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.779953 14076 raft_consensus.cc:504] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.780391 14076 leader_election.cc:288] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [CANDIDATE]: Term 1 election: Requested vote from peers 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059), b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401)
I20260811 07:27:02.780872 13673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1fa320eef34475b9e15a4812a4ae7d4" candidate_uuid: "b5f046845df1498bb45d7d6055d166de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d82de86855e4ffab9dbc9bd1f193689"
I20260811 07:27:02.780932 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1fa320eef34475b9e15a4812a4ae7d4" candidate_uuid: "b5f046845df1498bb45d7d6055d166de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45a0e7d714546d38a693e8e1c5a52d9"
I20260811 07:27:02.781035 13673 raft_consensus.cc:3037] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.781061 13827 raft_consensus.cc:3037] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.782433 13827 raft_consensus.cc:2454] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f046845df1498bb45d7d6055d166de in term 1.
I20260811 07:27:02.782784 13913 leader_election.cc:302] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45a0e7d714546d38a693e8e1c5a52d9, b5f046845df1498bb45d7d6055d166de; no voters:
I20260811 07:27:02.782902 13673 raft_consensus.cc:2454] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5f046845df1498bb45d7d6055d166de in term 1.
I20260811 07:27:02.783017 14076 raft_consensus.cc:2781] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:02.783332 14076 raft_consensus.cc:686] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 1 LEADER]: Becoming Leader. State: Replica: b5f046845df1498bb45d7d6055d166de, State: Running, Role: LEADER
I20260811 07:27:02.783612 14076 consensus_queue.cc:237] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.786618 13498 catalog_manager.cc:5495] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de reported cstate change: term changed from 0 to 1, leader changed from <none> to b5f046845df1498bb45d7d6055d166de (127.11.248.3). New cstate: current_term: 1 leader_uuid: "b5f046845df1498bb45d7d6055d166de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } health_report { overall_health: HEALTHY } } }
Aug 11 07:27:02 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:02.834333 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.822885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36509 (local address 127.0.0.1:52564)
0811 07:27:02.823367 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.823382 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.823491 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.823897 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.823899 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.824348 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:02.824452 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.824458 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.825954 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.825960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.826568 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.826577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.827280 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.827283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.827390 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.828064 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:02.828077 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:02.829693 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:02.832508 (+ 2815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.832526 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.832531 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.832853 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.833183 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:02.833186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:02.833187 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:02.833274 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:02.833792 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:02.833798 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:02.833927 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.834027 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.834165 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":19,"thread_start_us":198,"threads_started":1}
I20260811 07:27:02.834618 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.823020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52564 (local address 127.11.248.62:36509)
0811 07:27:02.823198 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.823204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.823485 (+ 281us) server_negotiation.cc:407] Connection header received
0811 07:27:02.823712 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.823715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.823768 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.823878 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:02.824579 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.825672 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.826696 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.827156 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.827309 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.829928 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:02.829934 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:02.829937 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:02.829982 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:02.832334 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.832965 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.832969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.832971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.833079 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:02.833359 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:02.833362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:02.833364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:02.833623 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:02.833806 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.834156 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.834342 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":58}
I20260811 07:27:02.840206 13498 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:52564:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:27:02.841584 13498 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:02.848021 13966 tablet_service.cc:1467] Processing CreateTablet for tablet 0ecfd5b687124afe84c0abbe82432da2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dcd73233f0d34019be14fe0391b6b04c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:02.848519 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ecfd5b687124afe84c0abbe82432da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.849630 13804 tablet_service.cc:1467] Processing CreateTablet for tablet 0ecfd5b687124afe84c0abbe82432da2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dcd73233f0d34019be14fe0391b6b04c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:02.850442 13804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ecfd5b687124afe84c0abbe82432da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.852523 14068 tablet_bootstrap.cc:492] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: Bootstrap starting.
I20260811 07:27:02.853238 13651 tablet_service.cc:1467] Processing CreateTablet for tablet 0ecfd5b687124afe84c0abbe82432da2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dcd73233f0d34019be14fe0391b6b04c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:02.853672 13651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ecfd5b687124afe84c0abbe82432da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:02.854085 14068 tablet_bootstrap.cc:654] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.856567 14068 tablet_bootstrap.cc:492] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: No bootstrap required, opened a new log
I20260811 07:27:02.856686 14068 ts_tablet_manager.cc:1397] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:02.857511 14069 tablet_bootstrap.cc:492] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: Bootstrap starting.
I20260811 07:27:02.858026 14068 raft_consensus.cc:348] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.858244 14068 raft_consensus.cc:374] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.858287 14068 raft_consensus.cc:729] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5f046845df1498bb45d7d6055d166de, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.858438 14068 consensus_queue.cc:260] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.858749 14076 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.858846 14068 ts_tablet_manager.cc:1428] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:27:02.858881 14076 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.859323 14069 tablet_bootstrap.cc:654] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.862355 14069 tablet_bootstrap.cc:492] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: No bootstrap required, opened a new log
I20260811 07:27:02.862486 14069 ts_tablet_manager.cc:1397] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 07:27:02.863341 14069 raft_consensus.cc:348] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.863482 14069 raft_consensus.cc:374] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.863521 14069 raft_consensus.cc:729] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d82de86855e4ffab9dbc9bd1f193689, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.863693 14069 consensus_queue.cc:260] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.863988 14069 ts_tablet_manager.cc:1428] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:27:02.864032 14096 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.864246 14096 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.868160 14070 tablet_bootstrap.cc:492] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: Bootstrap starting.
I20260811 07:27:02.870223 14070 tablet_bootstrap.cc:654] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:02.871917 14070 tablet_bootstrap.cc:492] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: No bootstrap required, opened a new log
I20260811 07:27:02.872042 14070 ts_tablet_manager.cc:1397] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 07:27:02.872587 14070 raft_consensus.cc:348] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.872715 14070 raft_consensus.cc:374] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:02.872761 14070 raft_consensus.cc:729] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45a0e7d714546d38a693e8e1c5a52d9, State: Initialized, Role: FOLLOWER
I20260811 07:27:02.872982 14070 consensus_queue.cc:260] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.873312 14070 ts_tablet_manager.cc:1428] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:27:02.873304 14075 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.873507 14075 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.917354 14075 raft_consensus.cc:482] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:02.917529 14075 raft_consensus.cc:504] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.918772 14075 leader_election.cc:288] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059), b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269)
I20260811 07:27:02.925001 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.919222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:44841 (local address 127.11.248.3:34269)
0811 07:27:02.919358 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.919363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.919890 (+ 527us) server_negotiation.cc:407] Connection header received
0811 07:27:02.919990 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.919992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.920044 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.920116 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.920504 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.921095 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.923400 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.924049 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.924187 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.924242 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.924713 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.924801 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:27:02.924906 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.919162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:54491 (local address 127.11.248.1:35059)
0811 07:27:02.919284 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.919288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.919619 (+ 331us) server_negotiation.cc:407] Connection header received
0811 07:27:02.919855 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.919860 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.919914 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.920002 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:02.920335 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.921127 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.923415 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.924049 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.924187 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.924254 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.924673 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.924756 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:27:02.925052 14122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.919000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:35059 (local address 127.11.248.2:54491)
0811 07:27:02.919518 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.919533 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.919705 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.920019 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.920022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.920035 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.920149 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.920155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.921246 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.921248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.923221 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.923234 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.924188 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.924192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.924484 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.924555 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.924638 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.924725 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":53,"thread_start_us":195,"threads_started":1}
I20260811 07:27:02.925555 13673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ecfd5b687124afe84c0abbe82432da2" candidate_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d82de86855e4ffab9dbc9bd1f193689" is_pre_election: true
I20260811 07:27:02.925698 13673 raft_consensus.cc:2454] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45a0e7d714546d38a693e8e1c5a52d9 in term 0.
I20260811 07:27:02.925734 14124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.919000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:34269 (local address 127.11.248.2:44841)
0811 07:27:02.919741 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.919769 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.919898 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.920135 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.920138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.920150 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:02.920386 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.920393 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.921205 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.921212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.923221 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.923234 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.924277 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.924280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.924503 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.924576 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.925467 (+ 891us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.925544 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":613,"thread_start_us":144,"threads_started":1}
I20260811 07:27:02.926262 13756 leader_election.cc:302] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d82de86855e4ffab9dbc9bd1f193689, b45a0e7d714546d38a693e8e1c5a52d9; no voters:
I20260811 07:27:02.926357 13991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ecfd5b687124afe84c0abbe82432da2" candidate_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f046845df1498bb45d7d6055d166de" is_pre_election: true
I20260811 07:27:02.926498 13991 raft_consensus.cc:2454] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45a0e7d714546d38a693e8e1c5a52d9 in term 0.
I20260811 07:27:02.926596 14075 raft_consensus.cc:2781] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:02.926661 14075 raft_consensus.cc:482] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:02.926712 14075 raft_consensus.cc:3037] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.927765 14075 raft_consensus.cc:504] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.928100 14075 leader_election.cc:288] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [CANDIDATE]: Term 1 election: Requested vote from peers 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059), b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269)
I20260811 07:27:02.928426 13673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ecfd5b687124afe84c0abbe82432da2" candidate_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d82de86855e4ffab9dbc9bd1f193689"
I20260811 07:27:02.928433 13991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ecfd5b687124afe84c0abbe82432da2" candidate_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5f046845df1498bb45d7d6055d166de"
I20260811 07:27:02.928556 13991 raft_consensus.cc:3037] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.928556 13673 raft_consensus.cc:3037] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:02.929994 13673 raft_consensus.cc:2454] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45a0e7d714546d38a693e8e1c5a52d9 in term 1.
I20260811 07:27:02.930004 13991 raft_consensus.cc:2454] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45a0e7d714546d38a693e8e1c5a52d9 in term 1.
I20260811 07:27:02.930344 13754 leader_election.cc:302] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b45a0e7d714546d38a693e8e1c5a52d9, b5f046845df1498bb45d7d6055d166de; no voters:
I20260811 07:27:02.930544 14075 raft_consensus.cc:2781] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:02.930751 14075 raft_consensus.cc:686] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 LEADER]: Becoming Leader. State: Replica: b45a0e7d714546d38a693e8e1c5a52d9, State: Running, Role: LEADER
I20260811 07:27:02.931051 14075 consensus_queue.cc:237] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } }
I20260811 07:27:02.932497 14126 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: TxnStatusTablet state changed. Reason: New leader b45a0e7d714546d38a693e8e1c5a52d9. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.932672 14126 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:02.933230 14128 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:27:02.933427 14128 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:27:02.933790 13498 catalog_manager.cc:5495] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } health_report { overall_health: UNKNOWN } } }
I20260811 07:27:02.951011 14117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.946950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40401 (local address 127.0.0.1:55404)
0811 07:27:02.947231 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.947244 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.947399 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.947816 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.947820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.947828 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:02.947943 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.947948 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.948729 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.948733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.949415 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.949426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.949878 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.949882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.949982 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.950032 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:02.950708 (+ 676us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:02.950727 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.950797 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.950887 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260811 07:27:02.951005 14067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.947044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55404 (local address 127.11.248.2:40401)
0811 07:27:02.947170 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.947175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.947304 (+ 129us) server_negotiation.cc:407] Connection header received
0811 07:27:02.947568 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.947571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.947673 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.947765 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:02.948045 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.948613 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.949534 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.949768 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.949874 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.950180 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:02.950606 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:02.950728 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.950807 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.950858 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 07:27:02.954353 13991 raft_consensus.cc:1261] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Refusing update from remote peer b45a0e7d714546d38a693e8e1c5a52d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:02.954502 13673 raft_consensus.cc:1261] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Refusing update from remote peer b45a0e7d714546d38a693e8e1c5a52d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:02.954927 14126 consensus_queue.cc:1035] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:02.955097 14075 consensus_queue.cc:1035] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:02.956584 14076 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: TxnStatusTablet state changed. Reason: New leader b45a0e7d714546d38a693e8e1c5a52d9. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.956707 14076 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.957031 14096 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: TxnStatusTablet state changed. Reason: New leader b45a0e7d714546d38a693e8e1c5a52d9. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.957162 14096 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.960089 14075 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.960216 14075 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:02.960345 14075 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.960436 14075 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b45a0e7d714546d38a693e8e1c5a52d9: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:02.960518 14085 mvcc.cc:205] Tried to move back new op lower bound from 7317230481214873600 to 7317230481128148992. Current Snapshot: MvccSnapshot[applied={T|T < 7317230481214873600}]
I20260811 07:27:02.960678 14096 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.960768 14096 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P 4d82de86855e4ffab9dbc9bd1f193689: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.961913 14076 tablet_replica.cc:439] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 } } peers { permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 } } peers { permanent_uuid: "b5f046845df1498bb45d7d6055d166de" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34269 } } }
I20260811 07:27:02.962013 14088 mvcc.cc:205] Tried to move back new op lower bound from 7317230481214873600 to 7317230481128148992. Current Snapshot: MvccSnapshot[applied={T|T < 7317230481214873600}]
I20260811 07:27:02.962065 14076 tablet_replica.cc:442] T 0ecfd5b687124afe84c0abbe82432da2 P b5f046845df1498bb45d7d6055d166de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:02.971695 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.967901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.11.248.3:34269)
0811 07:27:02.968037 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.968044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.968202 (+ 158us) server_negotiation.cc:407] Connection header received
0811 07:27:02.968391 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.968395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.968477 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.968584 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:02.968847 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.969353 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.970174 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.970402 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.970513 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.970794 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:02.971241 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:02.971362 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.971433 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.971489 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:27:02.985069 14067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.980398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:33459 (local address 127.11.248.2:40401)
0811 07:27:02.980556 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:02.980561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:02.980970 (+ 409us) server_negotiation.cc:407] Connection header received
0811 07:27:02.981105 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:02.981107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:02.981155 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:02.981223 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:02.981630 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.982149 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.983625 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.983892 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.983988 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.984452 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:02.984535 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:02.984609 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:02.984786 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 07:27:02.984960 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:27:02.985102 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:02.980284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40401 (local address 127.11.248.3:33459)
0811 07:27:02.980873 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:02.980891 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:02.981017 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:02.981255 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:02.981258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:02.981266 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:02.981509 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.981517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.982256 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.982260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.983465 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:02.983478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:02.984022 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:02.984026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:02.984173 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:02.984248 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:02.984635 (+ 387us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:02.984642 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:27:02.984737 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:27:02.984881 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":145,"threads_started":1}
I20260811 07:27:02.993772 13673 raft_consensus.cc:1261] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Refusing update from remote peer b5f046845df1498bb45d7d6055d166de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:02.993889 13827 raft_consensus.cc:1261] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Refusing update from remote peer b5f046845df1498bb45d7d6055d166de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:02.994385 14110 consensus_queue.cc:1035] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d82de86855e4ffab9dbc9bd1f193689" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 35059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:02.994635 14076 consensus_queue.cc:1035] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45a0e7d714546d38a693e8e1c5a52d9" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:03.022159 14065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:03.017320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48293 (local address 127.11.248.3:34269)
0811 07:27:03.017453 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:03.017462 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:03.017874 (+ 412us) server_negotiation.cc:407] Connection header received
0811 07:27:03.018034 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:03.018037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:03.018098 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:03.018172 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:03.018620 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.019456 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.020706 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.021125 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.021238 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:03.021605 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:03.021694 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:03.021776 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:03.021946 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 07:27:03.022005 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:27:03.022480 14144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:03.017230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:34269 (local address 127.11.248.2:48293)
0811 07:27:03.017778 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:03.017791 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:03.017924 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:03.018294 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:03.018298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:03.018308 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:03.018484 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:03.018496 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.019593 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.019596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:03.020581 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:03.020592 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.021237 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.021240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:03.021343 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:03.021445 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:03.021837 (+ 392us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:03.021844 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:27:03.021925 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:27:03.022012 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":248,"threads_started":1}
I20260811 07:27:03.053313 13499 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:03.053534 13499 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52560:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:03.056336 13499 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe6afb5c4ef34a73b3e7b70968d86b8d: Sending DeleteTablet for 3 replicas of tablet e1fa320eef34475b9e15a4812a4ae7d4
I20260811 07:27:03.057219 13651 tablet_service.cc:1514] Processing DeleteTablet for tablet e1fa320eef34475b9e15a4812a4ae7d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:03 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:33534
I20260811 07:27:03.057293 13966 tablet_service.cc:1514] Processing DeleteTablet for tablet e1fa320eef34475b9e15a4812a4ae7d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:03 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:53504
I20260811 07:27:03.057452 14099 tablet_replica.cc:330] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: stopping tablet replica
I20260811 07:27:03.057530 14101 tablet_replica.cc:330] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: stopping tablet replica
I20260811 07:27:03.057574 14099 raft_consensus.cc:2229] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:03.057643 14101 raft_consensus.cc:2229] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:03.057695 14099 raft_consensus.cc:2258] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:03.058054 14101 raft_consensus.cc:2258] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:03.059064 14101 ts_tablet_manager.cc:1905] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:03.059768 13804 tablet_service.cc:1514] Processing DeleteTablet for tablet e1fa320eef34475b9e15a4812a4ae7d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:03 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:55396
I20260811 07:27:03.060000 14102 tablet_replica.cc:330] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: stopping tablet replica
I20260811 07:27:03.060138 14102 raft_consensus.cc:2229] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:03.060256 14102 raft_consensus.cc:2258] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:03.061157 14099 ts_tablet_manager.cc:1905] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:03.063112 14101 ts_tablet_manager.cc:1918] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:03.063189 14101 log.cc:1196] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/e1fa320eef34475b9e15a4812a4ae7d4
I20260811 07:27:03.063472 14101 ts_tablet_manager.cc:1939] T e1fa320eef34475b9e15a4812a4ae7d4 P b5f046845df1498bb45d7d6055d166de: Deleting consensus metadata
I20260811 07:27:03.064272 13484 catalog_manager.cc:4841] TS b5f046845df1498bb45d7d6055d166de (127.11.248.3:34269): tablet e1fa320eef34475b9e15a4812a4ae7d4 (table test-table [id=1184bae017c34da7921773987f0f982a]) successfully deleted
I20260811 07:27:03.064437 14099 ts_tablet_manager.cc:1918] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:03.064517 14099 log.cc:1196] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/e1fa320eef34475b9e15a4812a4ae7d4
I20260811 07:27:03.064774 14099 ts_tablet_manager.cc:1939] T e1fa320eef34475b9e15a4812a4ae7d4 P 4d82de86855e4ffab9dbc9bd1f193689: Deleting consensus metadata
I20260811 07:27:03.065163 14102 ts_tablet_manager.cc:1905] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:03.066473 13486 catalog_manager.cc:4841] TS 4d82de86855e4ffab9dbc9bd1f193689 (127.11.248.1:35059): tablet e1fa320eef34475b9e15a4812a4ae7d4 (table test-table [id=1184bae017c34da7921773987f0f982a]) successfully deleted
I20260811 07:27:03.068804 14102 ts_tablet_manager.cc:1918] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:03.068936 14102 log.cc:1196] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/e1fa320eef34475b9e15a4812a4ae7d4
I20260811 07:27:03.069202 14102 ts_tablet_manager.cc:1939] T e1fa320eef34475b9e15a4812a4ae7d4 P b45a0e7d714546d38a693e8e1c5a52d9: Deleting consensus metadata
I20260811 07:27:03.069944 13486 catalog_manager.cc:4841] TS b45a0e7d714546d38a693e8e1c5a52d9 (127.11.248.2:40401): tablet e1fa320eef34475b9e15a4812a4ae7d4 (table test-table [id=1184bae017c34da7921773987f0f982a]) successfully deleted
Aug 11 07:27:03 dist-test-slave-77v9 krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433222, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:27:03.086318 14064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:03.067524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33554 (local address 127.11.248.1:35059)
0811 07:27:03.067683 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:03.067688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:03.069497 (+ 1809us) server_negotiation.cc:407] Connection header received
0811 07:27:03.069765 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:03.069768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:03.069846 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:03.069929 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:03.071465 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.072302 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.074103 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.074473 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.074587 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:03.079867 (+ 5280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:03.079888 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:03.079916 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:03.079958 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:03.082938 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:03.083728 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:03.083743 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:03.083746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:03.083944 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:03.084313 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:03.084316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:03.084318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:03.085075 (+ 757us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:03.085341 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:03.085689 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 07:27:03.086139 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 07:27:03.086843 13716 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33554
I20260811 07:27:03.100708 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:03.089147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.11.248.62:36509)
0811 07:27:03.089279 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:03.089283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:03.089457 (+ 174us) server_negotiation.cc:407] Connection header received
0811 07:27:03.089592 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:03.089595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:03.089650 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:03.089738 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:03.090696 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.091561 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.092980 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:03.093332 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:03.093448 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:03.095882 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:03.095886 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:03.095889 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:03.095924 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:03.098419 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:03.099087 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:03.099091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:03.099093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:03.099200 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:03.099587 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:03.099590 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:03.099592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:03.099872 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:03.100053 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:03.100354 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 07:27:03.100514 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 07:27:03.101336 13499 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52580
I20260811 07:27:03.103152 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 13580
I20260811 07:27:03.132553 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 13734
I20260811 07:27:03.143507 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 13893
I20260811 07:27:03.153419 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 13465
2026-08-11T07:27:03Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3148 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:03 dist-test-slave-77v9 krb5kdc[14154](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:03 dist-test-slave-77v9 krb5kdc[14154](info): set up 2 sockets
Aug 11 07:27:03 dist-test-slave-77v9 krb5kdc[14154](info): commencing operation
krb5kdc: starting...
W20260811 07:27:04.271894 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:04 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:04.416760 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:33007
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:33007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:04.541261 14169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:04.541646 14169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:04.541741 14169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:04.546123 14169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:04.546257 14169 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:27:04.546290 14169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:04.546326 14169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:04.546381 14169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:04.546419 14169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:04.552379 14169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:33007
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:33007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:04.553714 14169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:04.554828 14169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:04.564798 14175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:04.564798 14176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:04.564798 14178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:04.565153 14169 server_base.cc:1034] running on GCE node
I20260811 07:27:04.565958 14169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:04.567394 14169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:04.568647 14169 hybrid_clock.cc:648] HybridClock initialized: now 1786433224568610 us; error 54 us; skew 500 ppm
Aug 11 07:27:04 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:04.572220 14169 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:04.573450 14169 webserver.cc:460] Webserver started at http://127.11.248.62:37985/ using document root <none> and password file <none>
I20260811 07:27:04.574107 14169 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:04.574214 14169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:04.574479 14169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:04.577042 14169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "2b27abde4191461dab57e8311e285078"
format_stamp: "Formatted at 2026-08-11 07:27:04 on dist-test-slave-77v9"
server_key: "ae2591606c442328bcd86adfc2e048ac"
server_key_iv: "a8441b4ddfb1a73ed581e89cf961b9be"
server_key_version: "encryptionkey@0"
I20260811 07:27:04.577734 14169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "2b27abde4191461dab57e8311e285078"
format_stamp: "Formatted at 2026-08-11 07:27:04 on dist-test-slave-77v9"
server_key: "ae2591606c442328bcd86adfc2e048ac"
server_key_iv: "a8441b4ddfb1a73ed581e89cf961b9be"
server_key_version: "encryptionkey@0"
I20260811 07:27:04.582836 14169 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 07:27:04.585903 14185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:04.587405 14169 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:27:04.587591 14169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "2b27abde4191461dab57e8311e285078"
format_stamp: "Formatted at 2026-08-11 07:27:04 on dist-test-slave-77v9"
server_key: "ae2591606c442328bcd86adfc2e048ac"
server_key_iv: "a8441b4ddfb1a73ed581e89cf961b9be"
server_key_version: "encryptionkey@0"
I20260811 07:27:04.587743 14169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:04.620296 14169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:04.624053 14169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:04.624290 14169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:04.633999 14169 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:33007
I20260811 07:27:04.634018 14254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:33007 every 8 connection(s)
I20260811 07:27:04.635114 14169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:04.635946 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 14169
I20260811 07:27:04.636047 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:04.636344 12256 external_mini_cluster.cc:1428] Setting key 840fbb4a466e090296f240f5e8ca6286
I20260811 07:27:04.638655 14255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:04.646620 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Bootstrap starting.
Aug 11 07:27:04 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:04.649708 14255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:04.651168 14255 log.cc:824] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:04.653226 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:04.637919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.11.248.62:33007)
0811 07:27:04.638410 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:04.638430 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:04.638477 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:27:04.639388 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:04.639411 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:04.639843 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:04.640232 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:04.641125 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.642561 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.643762 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.644282 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.644420 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:04.647609 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:04.647616 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:04.647633 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:04.647672 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:04.649914 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:04.650402 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:04.650411 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:04.650420 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:04.650583 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:04.650858 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:04.650861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:04.650863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:04.651433 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:04.651644 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:04.652016 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 07:27:04.652382 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":136,"threads_started":1}
I20260811 07:27:04.653721 14255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: No bootstrap required, opened a new log
I20260811 07:27:04.656908 14255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b27abde4191461dab57e8311e285078" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33007 } }
I20260811 07:27:04.657196 14255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:04.657276 14255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b27abde4191461dab57e8311e285078, State: Initialized, Role: FOLLOWER
I20260811 07:27:04.657717 14255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b27abde4191461dab57e8311e285078" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33007 } }
I20260811 07:27:04.657883 14255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:04.657955 14255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:04.658042 14255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:04.659076 14255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b27abde4191461dab57e8311e285078" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33007 } }
I20260811 07:27:04.659440 14255 leader_election.cc:302] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b27abde4191461dab57e8311e285078; no voters:
I20260811 07:27:04.659783 14255 leader_election.cc:288] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:04.659981 14261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:04.660276 14261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b27abde4191461dab57e8311e285078, State: Running, Role: LEADER
I20260811 07:27:04.660609 14261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b27abde4191461dab57e8311e285078" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33007 } }
I20260811 07:27:04.661108 14255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:04.661826 14261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b27abde4191461dab57e8311e285078. Latest consensus state: current_term: 1 leader_uuid: "2b27abde4191461dab57e8311e285078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b27abde4191461dab57e8311e285078" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33007 } } }
I20260811 07:27:04.661943 14261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:04.662392 14262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b27abde4191461dab57e8311e285078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b27abde4191461dab57e8311e285078" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33007 } } }
I20260811 07:27:04.662485 14262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:04.662528 14268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:04.665917 14268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:04.672197 14268 catalog_manager.cc:1347] Generated new cluster ID: c48e599d76754a4184f8200ffb1b64fc
I20260811 07:27:04.672297 14268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:04.693854 14268 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:04.695276 14268 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:04.704214 14268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Generated new TSK 0
I20260811 07:27:04.705220 14268 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:04.741308 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33007
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:04.870528 14285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:04.870863 14285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:04.870916 14285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:04.875530 14285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:04.875651 14285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:04.875725 14285 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:27:04.875741 14285 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:04.875775 14285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:04.882093 14285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:33007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:04.883383 14285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:04.884601 14285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:04.896323 14291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:04.896479 14285 server_base.cc:1034] running on GCE node
W20260811 07:27:04.896323 14290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:04.896334 14294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:04.897228 14285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:04.898069 14285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:04.899268 14285 hybrid_clock.cc:648] HybridClock initialized: now 1786433224899249 us; error 39 us; skew 500 ppm
Aug 11 07:27:04 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:04.907924 14285 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:04.909102 14285 webserver.cc:460] Webserver started at http://127.11.248.1:38281/ using document root <none> and password file <none>
I20260811 07:27:04.909745 14285 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:04.909814 14285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:04.910044 14285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:04.912356 14285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53"
format_stamp: "Formatted at 2026-08-11 07:27:04 on dist-test-slave-77v9"
server_key: "3554bac4d8d31be1ba096753903a1e65"
server_key_iv: "98a24f4986e2998dfddb0db080f6ffe2"
server_key_version: "encryptionkey@0"
I20260811 07:27:04.913049 14285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53"
format_stamp: "Formatted at 2026-08-11 07:27:04 on dist-test-slave-77v9"
server_key: "3554bac4d8d31be1ba096753903a1e65"
server_key_iv: "98a24f4986e2998dfddb0db080f6ffe2"
server_key_version: "encryptionkey@0"
I20260811 07:27:04.917443 14285 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:04.920388 14301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:04.922240 14285 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:04.922428 14285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53"
format_stamp: "Formatted at 2026-08-11 07:27:04 on dist-test-slave-77v9"
server_key: "3554bac4d8d31be1ba096753903a1e65"
server_key_iv: "98a24f4986e2998dfddb0db080f6ffe2"
server_key_version: "encryptionkey@0"
I20260811 07:27:04.922588 14285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:04.949143 14285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:04.953145 14285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:04.953393 14285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:04.955238 14285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:04.955299 14285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:04.955343 14285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:04.955386 14285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:04 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:04.967069 14285 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:42905
I20260811 07:27:04.967092 14428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:42905 every 8 connection(s)
I20260811 07:27:04.968091 14285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:04.971019 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 14285
I20260811 07:27:04.971148 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:04.971323 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:04.956167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49153 (local address 127.11.248.62:33007)
0811 07:27:04.956347 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:04.956352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:04.957404 (+ 1052us) server_negotiation.cc:407] Connection header received
0811 07:27:04.958740 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:04.958747 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:04.958831 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:04.958949 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:04.960844 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.961788 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.963398 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.963794 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.963921 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:04.967174 (+ 3253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:04.967178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:04.967181 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:04.967215 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:04.968999 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:04.969604 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:04.969607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:04.969609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:04.969705 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:04.970065 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:04.970068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:04.970070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:04.970282 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:04.970395 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:04.970962 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 07:27:04.971123 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:27:04.971473 12256 external_mini_cluster.cc:1428] Setting key 1f7e90eef2f931cb90234d79ba10344f
I20260811 07:27:04.972272 14311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:04.956617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.11.248.1:49153)
0811 07:27:04.957181 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:04.957240 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:04.958409 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:04.959201 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:04.959213 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:04.959775 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:04.960626 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:04.960651 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.961957 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.961961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:04.963243 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:04.963254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.963986 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.963990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:04.964184 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:04.964937 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:04.964964 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:04.966958 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:04.969138 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:04.969145 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:04.969160 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:04.969495 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:04.969801 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:04.969805 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:04.969807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:04.969968 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:04.970407 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:04.970414 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:04.970668 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 07:27:04.970895 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 07:27:04.971281 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":206,"threads_started":1}
I20260811 07:27:04.975816 14429 heartbeater.cc:347] Connected to a master server at 127.11.248.62:33007
I20260811 07:27:04.976016 14429 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:04.976590 14429 heartbeater.cc:511] Master 127.11.248.62:33007 requested a full tablet report, sending...
I20260811 07:27:04.978292 14204 ts_manager.cc:194] Registered new tserver with Master: 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905)
I20260811 07:27:04.979759 14204 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:49153
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:27:04.985638 14439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:04.976090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.11.248.1:43849)
0811 07:27:04.976394 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:04.976412 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:04.976534 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:04.976863 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:04.976869 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:04.977162 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:04.977324 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:04.977334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.978448 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.978452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:04.979292 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:04.979305 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.980147 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.980151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:04.980265 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:04.980913 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:04.980936 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:04.981444 (+ 508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:04.983743 (+ 2299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:04.983745 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:04.983747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:04.984004 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:04.984340 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:04.984342 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:04.984343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:04.984424 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:04.985071 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:04.985073 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:04.985178 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:27:04.985304 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 07:27:04.985451 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":127,"threads_started":1}
I20260811 07:27:04.985662 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:04.976149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:43849 (local address 127.11.248.62:33007)
0811 07:27:04.976298 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:04.976303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:04.976498 (+ 195us) server_negotiation.cc:407] Connection header received
0811 07:27:04.976648 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:04.976651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:04.976700 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:04.976784 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:04.977452 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.978296 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.979556 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:04.979969 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:04.980090 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:04.981616 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:04.981624 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:04.981629 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:04.981661 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:04.983584 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:04.984129 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:04.984133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:04.984136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:04.984235 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:04.984510 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:04.984514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:04.984515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:04.984794 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:04.985077 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:04.985407 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 07:27:04.985535 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:05.008317 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33007
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:05.127672 14441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:05.127988 14441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:05.128041 14441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:05.132521 14441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:05.132649 14441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:05.132697 14441 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:27:05.132712 14441 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:05.132751 14441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:05.138648 14441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:33007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:05.139856 14441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:05.140986 14441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:05.151513 14449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:05.151490 14447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:05.151683 14441 server_base.cc:1034] running on GCE node
W20260811 07:27:05.151461 14446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:05.152323 14441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:05.153692 14441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:05.154932 14441 hybrid_clock.cc:648] HybridClock initialized: now 1786433225154911 us; error 37 us; skew 500 ppm
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:05.158362 14441 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:05.159369 14441 webserver.cc:460] Webserver started at http://127.11.248.2:41161/ using document root <none> and password file <none>
I20260811 07:27:05.160053 14441 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:05.160157 14441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:05.160408 14441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:05.163002 14441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "d11e63f43a1448f9b080bba7b86164ea"
format_stamp: "Formatted at 2026-08-11 07:27:05 on dist-test-slave-77v9"
server_key: "af3d596550471376ea6818a775ecb747"
server_key_iv: "5a8f417520bdbbcb4b38d4ce9f5fbe33"
server_key_version: "encryptionkey@0"
I20260811 07:27:05.163635 14441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "d11e63f43a1448f9b080bba7b86164ea"
format_stamp: "Formatted at 2026-08-11 07:27:05 on dist-test-slave-77v9"
server_key: "af3d596550471376ea6818a775ecb747"
server_key_iv: "5a8f417520bdbbcb4b38d4ce9f5fbe33"
server_key_version: "encryptionkey@0"
I20260811 07:27:05.167857 14441 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:05.170971 14457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:05.172246 14441 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 07:27:05.172397 14441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "d11e63f43a1448f9b080bba7b86164ea"
format_stamp: "Formatted at 2026-08-11 07:27:05 on dist-test-slave-77v9"
server_key: "af3d596550471376ea6818a775ecb747"
server_key_iv: "5a8f417520bdbbcb4b38d4ce9f5fbe33"
server_key_version: "encryptionkey@0"
I20260811 07:27:05.172534 14441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:05.193421 14441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:05.196954 14441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:05.197181 14441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:05.198693 14441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:05.198771 14441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:05.198854 14441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:05.198904 14441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:05.210286 14441 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:36223
I20260811 07:27:05.210430 14584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:36223 every 8 connection(s)
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:05.211392 14441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:05.215878 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.199708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:38067 (local address 127.11.248.62:33007)
0811 07:27:05.199845 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.199849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.201198 (+ 1349us) server_negotiation.cc:407] Connection header received
0811 07:27:05.202410 (+ 1212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.202413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.202479 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.202582 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:05.204501 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.205427 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.207431 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.207659 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.207769 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.211230 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:05.211235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:05.211238 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:05.211272 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:05.213220 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.213920 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.213924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.213927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.214047 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.214477 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.214480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.214482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.214746 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:05.214857 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.215567 (+ 710us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.215731 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 07:27:05.216764 14466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.200373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.11.248.2:38067)
0811 07:27:05.201036 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.201086 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.202145 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.202856 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.202865 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.203490 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:05.204273 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.204335 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.205599 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.205607 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.207255 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.207266 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.207845 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.207852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.208110 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.209052 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:05.209074 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:05.211007 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:05.213387 (+ 2380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.213393 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.213410 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.213778 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.214159 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.214162 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.214164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.214379 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.214851 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:05.214858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:05.215239 (+ 381us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.215511 (+ 272us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.215874 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":156,"threads_started":1}
I20260811 07:27:05.217499 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 14441
I20260811 07:27:05.217617 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:05.217938 12256 external_mini_cluster.cc:1428] Setting key 8517734f7a6d395cc042328d5fc69d6d
I20260811 07:27:05.218273 14586 heartbeater.cc:347] Connected to a master server at 127.11.248.62:33007
I20260811 07:27:05.218466 14586 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:05.219086 14586 heartbeater.cc:511] Master 127.11.248.62:33007 requested a full tablet report, sending...
I20260811 07:27:05.220310 14205 ts_manager.cc:194] Registered new tserver with Master: d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223)
I20260811 07:27:05.221117 14205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:38067
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:05.229122 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.220905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:38839 (local address 127.11.248.62:33007)
0811 07:27:05.221010 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.221014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.221282 (+ 268us) server_negotiation.cc:407] Connection header received
0811 07:27:05.221445 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.221448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.221493 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.221544 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:05.222297 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.223118 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.224061 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.224305 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.224422 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.225692 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:05.225696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:05.225699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:05.225724 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:05.227294 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.227803 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.227807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.227809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.227901 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.228180 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.228184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.228186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.228433 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:05.228546 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.228845 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.228972 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 07:27:05.229133 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.220863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.11.248.2:38839)
0811 07:27:05.221200 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.221216 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.221323 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.221684 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.221688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.221973 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:05.222145 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.222155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.223297 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.223301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.223937 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.223946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.224426 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.224430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.224524 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.225174 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:05.225185 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:05.225549 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:05.227408 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.227412 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.227415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.227627 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.227994 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.227998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.228000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.228090 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.228533 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:05.228536 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:05.228641 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.228748 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.228930 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":142,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:05.252985 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:33007
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:05.370124 14595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:05.370427 14595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:05.370478 14595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:05.374600 14595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:05.374688 14595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:05.374733 14595 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:27:05.374747 14595 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:05.374786 14595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:05.380419 14595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:33007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:05.381583 14595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:05.382602 14595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:05.393101 14602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:05.393194 14605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:05.393157 14603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:05.393433 14595 server_base.cc:1034] running on GCE node
I20260811 07:27:05.393997 14595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:05.394847 14595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:05.396067 14595 hybrid_clock.cc:648] HybridClock initialized: now 1786433225396048 us; error 31 us; skew 500 ppm
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:05.399137 14595 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:05.400069 14595 webserver.cc:460] Webserver started at http://127.11.248.3:36215/ using document root <none> and password file <none>
I20260811 07:27:05.400715 14595 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:05.400779 14595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:05.401010 14595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:05.403079 14595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "8af44672ed4246d1be704d34d0c55915"
format_stamp: "Formatted at 2026-08-11 07:27:05 on dist-test-slave-77v9"
server_key: "f05af6da9bcdbec69047cf43f90ababe"
server_key_iv: "429a2c503d4482be3ed66fba7e0b246b"
server_key_version: "encryptionkey@0"
I20260811 07:27:05.403620 14595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "8af44672ed4246d1be704d34d0c55915"
format_stamp: "Formatted at 2026-08-11 07:27:05 on dist-test-slave-77v9"
server_key: "f05af6da9bcdbec69047cf43f90ababe"
server_key_iv: "429a2c503d4482be3ed66fba7e0b246b"
server_key_version: "encryptionkey@0"
I20260811 07:27:05.407752 14595 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:05.410669 14613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:05.412133 14595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:05.412248 14595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "8af44672ed4246d1be704d34d0c55915"
format_stamp: "Formatted at 2026-08-11 07:27:05 on dist-test-slave-77v9"
server_key: "f05af6da9bcdbec69047cf43f90ababe"
server_key_iv: "429a2c503d4482be3ed66fba7e0b246b"
server_key_version: "encryptionkey@0"
I20260811 07:27:05.412420 14595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:05.431123 14595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:05.436192 14595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:05.436457 14595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:05.438414 14595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:05.438510 14595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:05.438578 14595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:05.438614 14595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:05.451213 14595 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:33361
I20260811 07:27:05.451436 14737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:33361 every 8 connection(s)
I20260811 07:27:05.452256 14595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:05.454941 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.439482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:49327 (local address 127.11.248.62:33007)
0811 07:27:05.439673 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.439679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.441238 (+ 1559us) server_negotiation.cc:407] Connection header received
0811 07:27:05.442863 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.442870 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.443058 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.443189 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:05.444846 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.445541 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.446992 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.447293 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.447436 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.450609 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:05.450613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:05.450622 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:05.450655 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:05.452605 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.453348 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.453352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.453354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.453469 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.453817 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.453820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.453821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.454021 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:05.454098 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.454666 (+ 568us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.454801 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:27:05.455823 14622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.440440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.11.248.3:49327)
0811 07:27:05.441044 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.441106 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.442566 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.443505 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.443515 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.443997 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:05.444632 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.444649 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.445695 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.445699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.446842 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.446855 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.447500 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.447505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.447702 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.448455 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:05.448474 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:05.450385 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:05.452785 (+ 2400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.452791 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.452808 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.453228 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.453567 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.453569 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.453571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.453724 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.454113 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:05.454119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:05.454376 (+ 257us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.454544 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.454897 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":169,"threads_started":1}
I20260811 07:27:05.457427 14738 heartbeater.cc:347] Connected to a master server at 127.11.248.62:33007
I20260811 07:27:05.457597 14738 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:05.458237 14738 heartbeater.cc:511] Master 127.11.248.62:33007 requested a full tablet report, sending...
I20260811 07:27:05.459628 14205 ts_manager.cc:194] Registered new tserver with Master: 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361)
I20260811 07:27:05.460532 14205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:49327
I20260811 07:27:05.461442 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 14595
I20260811 07:27:05.461584 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:05.461968 12256 external_mini_cluster.cc:1428] Setting key da70dcf0b1e794ecba6de569d3209094
I20260811 07:27:05.464923 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:27:05.468350 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.460098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44547 (local address 127.11.248.62:33007)
0811 07:27:05.460227 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.460232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.460509 (+ 277us) server_negotiation.cc:407] Connection header received
0811 07:27:05.460642 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.460646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.460708 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.460806 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:05.461451 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.462216 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.463396 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.463655 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.463771 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.465151 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:05.465155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:05.465157 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:05.465181 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:05.466617 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.467093 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.467096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.467098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.467187 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.467488 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.467492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.467494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.467687 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:05.467795 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.468071 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.468189 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:27:05.468362 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.459961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.11.248.3:44547)
0811 07:27:05.460400 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.460414 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.460526 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.460845 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.460850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.461123 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:05.461282 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.461290 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.462431 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.462433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.463262 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.463272 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.463775 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.463779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.463877 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.464483 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:05.464501 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:05.464985 (+ 484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:05.466744 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.466748 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.466750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.466978 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.467283 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.467287 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.467289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.467380 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.467797 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:05.467800 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:05.467900 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.468011 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.468181 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":121,"threads_started":1}
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:05.495070 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.485596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47136 (local address 127.11.248.62:33007)
0811 07:27:05.485750 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.485754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.485769 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:05.485824 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.485826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.485869 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.485950 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:05.486893 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.487440 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.488275 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.488515 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.488623 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.491607 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:05.491611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:05.491613 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:05.491643 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:05.493445 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.493895 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.493897 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.493899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.493978 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.494290 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.494293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.494294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.494497 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:05.494609 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.494824 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.494931 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:27:05.498520 14205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:05.501837 14205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:05.517102 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.510976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36223 (local address 127.0.0.1:53854)
0811 07:27:05.511907 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.511964 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.512107 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.512956 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.512959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.512988 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.513218 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.513223 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.514260 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.514265 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.515525 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.515534 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.516461 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.516464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.516586 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.516631 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.516751 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.516922 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":72,"spinlock_wait_cycles":15104,"thread_start_us":100,"threads_started":1}
I20260811 07:27:05.517136 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.511172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53854 (local address 127.11.248.2:36223)
0811 07:27:05.511672 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.511685 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.512248 (+ 563us) server_negotiation.cc:407] Connection header received
0811 07:27:05.512365 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.512370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.512589 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.512756 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.513370 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.514139 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.515645 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.516348 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.516461 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.516638 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.516797 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.516982 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":133,"threads_started":1}
I20260811 07:27:05.517961 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.511452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.0.0.1:44616)
0811 07:27:05.511907 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.511964 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.512107 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.512956 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.512959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.512987 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.513216 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.513223 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.514672 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.514676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.515982 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.515993 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.517471 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.517474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.517594 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.517619 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.517687 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.517814 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":176,"spinlock_wait_cycles":8704,"thread_start_us":97,"threads_started":1}
I20260811 07:27:05.518050 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.510873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50376 (local address 127.11.248.3:33361)
0811 07:27:05.511654 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.511670 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.512080 (+ 410us) server_negotiation.cc:407] Connection header received
0811 07:27:05.512368 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.512373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.512589 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.512757 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.513219 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.514527 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.516356 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.517206 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.517597 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.517757 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.517810 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.517908 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":669,"thread_start_us":120,"threads_started":1}
I20260811 07:27:05.518388 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.510655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:33361 (local address 127.0.0.1:50376)
0811 07:27:05.511974 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.511991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.512162 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.512771 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.512780 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.512856 (+ 76us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.513060 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.513074 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.514672 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.514676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.516161 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.516168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.517430 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.517434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.517528 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.517612 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.517685 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.517805 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":366,"thread_start_us":140,"threads_started":1}
I20260811 07:27:05.518527 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.511952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44616 (local address 127.11.248.1:42905)
0811 07:27:05.512476 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.512481 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.512499 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:27:05.512562 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.512566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.512739 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.512907 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.513354 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.514527 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.516137 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.517128 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.517250 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.517400 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.518277 (+ 877us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.518387 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":107,"threads_started":1}
I20260811 07:27:05.520772 14509 tablet_service.cc:1467] Processing CreateTablet for tablet 25d23ad1d28046cc80276e99d1c9bf86 (DEFAULT_TABLE table=test-table [id=cef2e190a13d4eb595fb2d3491f22763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:05.522118 14509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d23ad1d28046cc80276e99d1c9bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.523659 14351 tablet_service.cc:1467] Processing CreateTablet for tablet 25d23ad1d28046cc80276e99d1c9bf86 (DEFAULT_TABLE table=test-table [id=cef2e190a13d4eb595fb2d3491f22763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:05.523670 14664 tablet_service.cc:1467] Processing CreateTablet for tablet 25d23ad1d28046cc80276e99d1c9bf86 (DEFAULT_TABLE table=test-table [id=cef2e190a13d4eb595fb2d3491f22763]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:05.524659 14351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d23ad1d28046cc80276e99d1c9bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.524724 14664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d23ad1d28046cc80276e99d1c9bf86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.530982 14764 tablet_bootstrap.cc:492] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Bootstrap starting.
I20260811 07:27:05.532183 14765 tablet_bootstrap.cc:492] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Bootstrap starting.
I20260811 07:27:05.532733 14766 tablet_bootstrap.cc:492] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Bootstrap starting.
I20260811 07:27:05.533793 14764 tablet_bootstrap.cc:654] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.534472 14765 tablet_bootstrap.cc:654] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.534780 14766 tablet_bootstrap.cc:654] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.535027 14764 log.cc:824] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:05.535359 14765 log.cc:824] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:05.535601 14766 log.cc:824] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:05.537420 14765 tablet_bootstrap.cc:492] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: No bootstrap required, opened a new log
I20260811 07:27:05.537420 14764 tablet_bootstrap.cc:492] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: No bootstrap required, opened a new log
I20260811 07:27:05.537460 14766 tablet_bootstrap.cc:492] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: No bootstrap required, opened a new log
I20260811 07:27:05.537638 14765 ts_tablet_manager.cc:1397] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:27:05.537638 14764 ts_tablet_manager.cc:1397] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:27:05.537667 14766 ts_tablet_manager.cc:1397] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260811 07:27:05.540788 14766 raft_consensus.cc:348] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.541203 14766 raft_consensus.cc:374] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.541287 14766 raft_consensus.cc:729] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.541819 14766 consensus_queue.cc:260] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.541921 14765 raft_consensus.cc:348] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.542193 14765 raft_consensus.cc:374] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.542243 14765 raft_consensus.cc:729] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11e63f43a1448f9b080bba7b86164ea, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.542339 14764 raft_consensus.cc:348] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.542646 14764 raft_consensus.cc:374] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.542701 14764 raft_consensus.cc:729] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.542691 14765 consensus_queue.cc:260] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.543149 14766 ts_tablet_manager.cc:1428] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260811 07:27:05.543179 14764 consensus_queue.cc:260] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.543555 14738 heartbeater.cc:503] Master 127.11.248.62:33007 was elected leader, sending a full tablet report...
I20260811 07:27:05.543676 14765 ts_tablet_manager.cc:1428] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:27:05.544003 14429 heartbeater.cc:503] Master 127.11.248.62:33007 was elected leader, sending a full tablet report...
I20260811 07:27:05.544001 14586 heartbeater.cc:503] Master 127.11.248.62:33007 was elected leader, sending a full tablet report...
I20260811 07:27:05.545042 14764 ts_tablet_manager.cc:1428] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260811 07:27:05.611428 14771 raft_consensus.cc:482] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:05.611727 14771 raft_consensus.cc:504] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.613101 14771 leader_election.cc:288] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361), 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905)
I20260811 07:27:05.617226 14466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.613291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:33361 (local address 127.11.248.2:37609)
0811 07:27:05.613515 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.613531 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.613627 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.613923 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.613926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.613954 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.614083 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.614089 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.614907 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.614914 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.615860 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.615870 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.616697 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.616701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.616856 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.616888 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.616992 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.617077 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":23}
I20260811 07:27:05.617226 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.613469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:37609 (local address 127.11.248.3:33361)
0811 07:27:05.613627 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.613634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.613655 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:27:05.613719 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.613722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.613782 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.613899 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.614201 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.614785 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.616083 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.616541 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.616713 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.616779 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.617007 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.617085 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:27:05.617723 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.613437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.11.248.2:57467)
0811 07:27:05.613882 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.613893 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.614014 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.614277 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.614280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.614294 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.614765 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.614778 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.615523 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.615528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.616363 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.616372 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.617269 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.617274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.617378 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.617408 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.617500 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.617564 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":26,"thread_start_us":191,"threads_started":1}
I20260811 07:27:05.617764 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.613574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:57467 (local address 127.11.248.1:42905)
0811 07:27:05.613721 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.613726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.613984 (+ 258us) server_negotiation.cc:407] Connection header received
0811 07:27:05.614122 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.614125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.614172 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.614265 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.614900 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.615404 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.616487 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.617128 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.617284 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.617346 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.617531 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.617625 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:27:05.617998 14689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d23ad1d28046cc80276e99d1c9bf86" candidate_uuid: "d11e63f43a1448f9b080bba7b86164ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af44672ed4246d1be704d34d0c55915" is_pre_election: true
I20260811 07:27:05.618386 14689 raft_consensus.cc:2454] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d11e63f43a1448f9b080bba7b86164ea in term 0.
I20260811 07:27:05.618558 14374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d23ad1d28046cc80276e99d1c9bf86" candidate_uuid: "d11e63f43a1448f9b080bba7b86164ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" is_pre_election: true
I20260811 07:27:05.618880 14374 raft_consensus.cc:2454] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d11e63f43a1448f9b080bba7b86164ea in term 0.
I20260811 07:27:05.618952 14460 leader_election.cc:302] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8af44672ed4246d1be704d34d0c55915, d11e63f43a1448f9b080bba7b86164ea; no voters:
I20260811 07:27:05.619503 14771 raft_consensus.cc:2781] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:05.619592 14771 raft_consensus.cc:482] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:05.619630 14771 raft_consensus.cc:3037] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.620741 14771 raft_consensus.cc:504] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.621192 14771 leader_election.cc:288] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [CANDIDATE]: Term 1 election: Requested vote from peers 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361), 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905)
I20260811 07:27:05.621544 14689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d23ad1d28046cc80276e99d1c9bf86" candidate_uuid: "d11e63f43a1448f9b080bba7b86164ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af44672ed4246d1be704d34d0c55915"
I20260811 07:27:05.621641 14374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d23ad1d28046cc80276e99d1c9bf86" candidate_uuid: "d11e63f43a1448f9b080bba7b86164ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53"
I20260811 07:27:05.621716 14689 raft_consensus.cc:3037] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.621801 14374 raft_consensus.cc:3037] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.622915 14374 raft_consensus.cc:2454] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d11e63f43a1448f9b080bba7b86164ea in term 1.
I20260811 07:27:05.622921 14689 raft_consensus.cc:2454] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d11e63f43a1448f9b080bba7b86164ea in term 1.
I20260811 07:27:05.623263 14460 leader_election.cc:302] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8af44672ed4246d1be704d34d0c55915, d11e63f43a1448f9b080bba7b86164ea; no voters:
I20260811 07:27:05.623462 14771 raft_consensus.cc:2781] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:05.623697 14771 raft_consensus.cc:686] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 1 LEADER]: Becoming Leader. State: Replica: d11e63f43a1448f9b080bba7b86164ea, State: Running, Role: LEADER
I20260811 07:27:05.624061 14771 consensus_queue.cc:237] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } }
I20260811 07:27:05.627576 14205 catalog_manager.cc:5495] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d11e63f43a1448f9b080bba7b86164ea (127.11.248.2). New cstate: current_term: 1 leader_uuid: "d11e63f43a1448f9b080bba7b86164ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:27:05 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433224, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:05.665534 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.654966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33007 (local address 127.0.0.1:47148)
0811 07:27:05.655322 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.655340 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.655473 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.655803 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.655806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.656251 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:05.656360 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.656366 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.657473 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.657476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.658180 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.658191 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.658747 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.658750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.658863 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.659493 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:05.659507 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:05.661356 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:05.663687 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.663703 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.663711 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.663978 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.664284 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:05.664287 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:05.664289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:05.664375 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:05.664776 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:05.664786 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:05.664939 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.665058 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.665315 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":24,"thread_start_us":170,"threads_started":1}
I20260811 07:27:05.665532 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.655008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.11.248.62:33007)
0811 07:27:05.655171 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.655175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.655437 (+ 262us) server_negotiation.cc:407] Connection header received
0811 07:27:05.655558 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.655561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.655607 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.655700 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:05.656549 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.657322 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.658316 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.658618 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.658725 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.661566 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:05.661570 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:05.661572 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:05.661599 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:05.663575 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.664089 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.664094 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.664096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.664180 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:05.664467 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:05.664470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:05.664472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:05.664666 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:05.664768 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.665119 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.665373 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":121,"server-negotiator.queue_time_us":67}
I20260811 07:27:05.670156 14205 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:47148:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:27:05.671026 14205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:05.676684 14351 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6bb2e12c98460f89840ec51307adf8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=53b3266e71a0402aa6131cb87df17f28]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:05.676684 14509 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6bb2e12c98460f89840ec51307adf8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=53b3266e71a0402aa6131cb87df17f28]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:05.677099 14664 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6bb2e12c98460f89840ec51307adf8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=53b3266e71a0402aa6131cb87df17f28]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:05.677572 14509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6bb2e12c98460f89840ec51307adf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.677572 14351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6bb2e12c98460f89840ec51307adf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.677788 14664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6bb2e12c98460f89840ec51307adf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.680387 14766 tablet_bootstrap.cc:492] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: Bootstrap starting.
I20260811 07:27:05.680536 14764 tablet_bootstrap.cc:492] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Bootstrap starting.
I20260811 07:27:05.680554 14765 tablet_bootstrap.cc:492] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: Bootstrap starting.
I20260811 07:27:05.681453 14766 tablet_bootstrap.cc:654] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.681579 14765 tablet_bootstrap.cc:654] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.681579 14764 tablet_bootstrap.cc:654] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.683115 14765 tablet_bootstrap.cc:492] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: No bootstrap required, opened a new log
I20260811 07:27:05.683202 14764 tablet_bootstrap.cc:492] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: No bootstrap required, opened a new log
I20260811 07:27:05.683216 14765 ts_tablet_manager.cc:1397] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:05.683286 14764 ts_tablet_manager.cc:1397] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:05.683736 14764 raft_consensus.cc:348] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.683717 14765 raft_consensus.cc:348] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.683868 14764 raft_consensus.cc:374] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.683868 14765 raft_consensus.cc:374] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.683904 14765 raft_consensus.cc:729] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11e63f43a1448f9b080bba7b86164ea, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.683904 14764 raft_consensus.cc:729] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.684041 14765 consensus_queue.cc:260] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.684041 14764 consensus_queue.cc:260] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.684310 14764 ts_tablet_manager.cc:1428] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:27:05.684302 14771 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.684459 14771 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:05.684667 14772 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.684320 14765 ts_tablet_manager.cc:1428] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:27:05.685037 14772 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:05.685164 14766 tablet_bootstrap.cc:492] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: No bootstrap required, opened a new log
I20260811 07:27:05.685266 14766 ts_tablet_manager.cc:1397] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 07:27:05.685688 14766 raft_consensus.cc:348] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.685773 14766 raft_consensus.cc:374] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.685796 14766 raft_consensus.cc:729] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.685899 14766 consensus_queue.cc:260] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.686178 14766 ts_tablet_manager.cc:1428] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:27:05.686146 14770 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.686268 14770 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 07:27:05.703483 14739 tablet.cc:2369] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:05.709554 14772 raft_consensus.cc:482] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:05.709738 14772 raft_consensus.cc:504] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.711068 14772 leader_election.cc:288] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223), 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361)
W20260811 07:27:05.712678 14587 tablet.cc:2369] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:05.715731 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.711430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:35745 (local address 127.11.248.3:33361)
0811 07:27:05.711583 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.711588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.711952 (+ 364us) server_negotiation.cc:407] Connection header received
0811 07:27:05.712014 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.712017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.712067 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.712144 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.712624 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.713352 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.714650 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.715132 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.715227 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.715268 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.715527 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.715598 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:05.715848 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.711324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:33361 (local address 127.11.248.1:35745)
0811 07:27:05.711843 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.711857 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.711945 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.712223 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.712226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.712275 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.712474 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.712486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.713464 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.713467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.714518 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.714529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.715268 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.715273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.715377 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.715405 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.715499 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.715573 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":49,"spinlock_wait_cycles":31872,"thread_start_us":140,"threads_started":1}
I20260811 07:27:05.715986 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.711494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:45163 (local address 127.11.248.2:36223)
0811 07:27:05.711716 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.711719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.711798 (+ 79us) server_negotiation.cc:407] Connection header received
0811 07:27:05.711976 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.711980 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.712033 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.712126 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.713190 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.713867 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.714932 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.715423 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.715535 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.715580 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.715774 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.715862 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260811 07:27:05.716109 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.711315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36223 (local address 127.11.248.1:45163)
0811 07:27:05.711696 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.711711 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.711842 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.712223 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.712226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.712276 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.713061 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.713070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.714007 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.714010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.714803 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.714813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.715539 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.715543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.715640 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.715662 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.715742 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.715820 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":54,"spinlock_wait_cycles":11136,"thread_start_us":154,"threads_started":1}
I20260811 07:27:05.716423 14689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6bb2e12c98460f89840ec51307adf8" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af44672ed4246d1be704d34d0c55915" is_pre_election: true
I20260811 07:27:05.716607 14689 raft_consensus.cc:2454] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 0.
I20260811 07:27:05.716885 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6bb2e12c98460f89840ec51307adf8" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea" is_pre_election: true
I20260811 07:27:05.717042 14304 leader_election.cc:302] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, 8af44672ed4246d1be704d34d0c55915; no voters:
I20260811 07:27:05.717160 14532 raft_consensus.cc:2454] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 0.
I20260811 07:27:05.717495 14772 raft_consensus.cc:2781] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:05.717584 14772 raft_consensus.cc:482] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:05.717638 14772 raft_consensus.cc:3037] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.718856 14772 raft_consensus.cc:504] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.719264 14772 leader_election.cc:288] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 election: Requested vote from peers d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223), 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361)
I20260811 07:27:05.719717 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6bb2e12c98460f89840ec51307adf8" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea"
I20260811 07:27:05.719726 14689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6bb2e12c98460f89840ec51307adf8" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af44672ed4246d1be704d34d0c55915"
I20260811 07:27:05.719861 14532 raft_consensus.cc:3037] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.719873 14689 raft_consensus.cc:3037] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Advancing to term 1
W20260811 07:27:05.721145 14431 tablet.cc:2369] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:05.721163 14689 raft_consensus.cc:2454] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 1.
I20260811 07:27:05.721163 14532 raft_consensus.cc:2454] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 1.
I20260811 07:27:05.721484 14306 leader_election.cc:302] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, d11e63f43a1448f9b080bba7b86164ea; no voters:
I20260811 07:27:05.721670 14772 raft_consensus.cc:2781] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:05.721909 14772 raft_consensus.cc:686] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 LEADER]: Becoming Leader. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Running, Role: LEADER
I20260811 07:27:05.722271 14772 consensus_queue.cc:237] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.724864 14787 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: TxnStatusTablet state changed. Reason: New leader 7dcb55dfcfa0457d8a5da3b1007cfc53. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.724987 14787 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:05.725302 14789 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:27:05.725548 14789 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:27:05.725732 14205 catalog_manager.cc:5495] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1). New cstate: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } health_report { overall_health: UNKNOWN } } }
I20260811 07:27:05.747278 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.743592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44632 (local address 127.11.248.1:42905)
0811 07:27:05.743755 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.743760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.743779 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:27:05.743881 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.743883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.743940 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.744044 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.744296 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.744859 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.745739 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.745966 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.746071 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.746386 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.746860 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.746994 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.747061 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.747123 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:05.747278 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.743424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.0.0.1:44632)
0811 07:27:05.743586 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.743605 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.743726 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.744057 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.744060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.744067 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:05.744184 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.744189 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.744977 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.744980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.745606 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.745615 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.746087 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.746090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.746182 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.746232 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.746961 (+ 729us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.746979 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.747051 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.747153 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 07:27:05.753226 14532 raft_consensus.cc:1261] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Refusing update from remote peer 7dcb55dfcfa0457d8a5da3b1007cfc53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:05.753288 14689 raft_consensus.cc:1261] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Refusing update from remote peer 7dcb55dfcfa0457d8a5da3b1007cfc53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:05.753950 14787 consensus_queue.cc:1035] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:05.754263 14772 consensus_queue.cc:1035] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:05.757767 14771 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: TxnStatusTablet state changed. Reason: New leader 7dcb55dfcfa0457d8a5da3b1007cfc53. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.757928 14771 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:05.758404 14770 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: TxnStatusTablet state changed. Reason: New leader 7dcb55dfcfa0457d8a5da3b1007cfc53. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.758539 14770 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:05.762153 14772 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.762296 14772 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:05.762750 14793 mvcc.cc:205] Tried to move back new op lower bound from 7317230492677509120 to 7317230492561260544. Current Snapshot: MvccSnapshot[applied={T|T < 7317230492677509120}]
I20260811 07:27:05.763087 14787 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.763201 14787 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 7dcb55dfcfa0457d8a5da3b1007cfc53: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:05.764259 14771 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.764384 14771 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P d11e63f43a1448f9b080bba7b86164ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:05.764364 14770 tablet_replica.cc:439] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } } }
I20260811 07:27:05.764494 14770 tablet_replica.cc:442] T 0d6bb2e12c98460f89840ec51307adf8 P 8af44672ed4246d1be704d34d0c55915: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:05.764998 14795 mvcc.cc:205] Tried to move back new op lower bound from 7317230492677509120 to 7317230492561260544. Current Snapshot: MvccSnapshot[applied={T|T < 7317230492677509120}]
I20260811 07:27:05.765185 14794 mvcc.cc:205] Tried to move back new op lower bound from 7317230492677509120 to 7317230492561260544. Current Snapshot: MvccSnapshot[applied={T|T < 7317230492677509120}]
I20260811 07:27:05.777673 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.773440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.11.248.2:36223)
0811 07:27:05.773600 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.773605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.773620 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:05.773875 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.773877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.773934 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.774048 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.774321 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.774895 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.775808 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.776152 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.776260 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.776554 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.777161 (+ 607us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.777302 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.777446 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.777512 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:27:05.790781 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.786821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:53983 (local address 127.11.248.1:42905)
0811 07:27:05.786973 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.786984 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.787141 (+ 157us) server_negotiation.cc:407] Connection header received
0811 07:27:05.787277 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.787279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.787330 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.787404 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.787710 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.788270 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.789583 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.789828 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.789928 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.790321 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.790404 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.790475 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.790603 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.790658 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:27:05.790846 14805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.786640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.11.248.2:53983)
0811 07:27:05.787018 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.787035 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.787160 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.787437 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.787440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.787449 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:05.787586 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.787592 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.788392 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.788395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.789434 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.789446 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.789961 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.789965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.790056 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.790114 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.790502 (+ 388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.790509 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.790582 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.790669 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":149,"threads_started":1}
I20260811 07:27:05.798722 14689 raft_consensus.cc:1261] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Refusing update from remote peer d11e63f43a1448f9b080bba7b86164ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:05.798864 14374 raft_consensus.cc:1261] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Refusing update from remote peer d11e63f43a1448f9b080bba7b86164ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:05.799286 14774 consensus_queue.cc:1035] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:05.799469 14771 consensus_queue.cc:1035] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:05.826268 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.821961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:57103 (local address 127.11.248.2:36223)
0811 07:27:05.822110 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.822116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.822371 (+ 255us) server_negotiation.cc:407] Connection header received
0811 07:27:05.822738 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.822741 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.822795 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.822893 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.823210 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.824012 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.824992 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.825348 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.825454 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.825735 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.825834 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.825907 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.826052 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.826114 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:27:05.826347 14812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.821826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36223 (local address 127.11.248.1:57103)
0811 07:27:05.822269 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.822286 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.822432 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.822911 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.822914 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.822924 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:05.823073 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.823081 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.824124 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.824128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.824861 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.824872 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.825462 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.825465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.825546 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.825600 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.825937 (+ 337us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.825946 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.826031 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.826142 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":140,"threads_started":1}
I20260811 07:27:05.859120 14205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:05.859375 14205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:05.862744 14205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Sending DeleteTablet for 3 replicas of tablet 25d23ad1d28046cc80276e99d1c9bf86
I20260811 07:27:05.863772 14664 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d23ad1d28046cc80276e99d1c9bf86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:05 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:50376
I20260811 07:27:05.863960 14509 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d23ad1d28046cc80276e99d1c9bf86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:05 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:53854
I20260811 07:27:05.864430 14817 tablet_replica.cc:330] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: stopping tablet replica
I20260811 07:27:05.864794 14817 raft_consensus.cc:2229] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:05.865087 14817 raft_consensus.cc:2258] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:05.865978 14351 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d23ad1d28046cc80276e99d1c9bf86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:05 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:44616
I20260811 07:27:05.866892 14817 ts_tablet_manager.cc:1905] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:05.866860 14205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:05.867370 14205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:05.869390 14818 tablet_replica.cc:330] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: stopping tablet replica
I20260811 07:27:05.871227 14817 ts_tablet_manager.cc:1918] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:05.871377 14817 log.cc:1196] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/25d23ad1d28046cc80276e99d1c9bf86
I20260811 07:27:05.871752 14817 ts_tablet_manager.cc:1939] T 25d23ad1d28046cc80276e99d1c9bf86 P 8af44672ed4246d1be704d34d0c55915: Deleting consensus metadata
I20260811 07:27:05.873216 14188 catalog_manager.cc:4841] TS 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361): tablet 25d23ad1d28046cc80276e99d1c9bf86 (table test-table [id=cef2e190a13d4eb595fb2d3491f22763]) successfully deleted
I20260811 07:27:05.874806 14819 tablet_replica.cc:330] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: stopping tablet replica
I20260811 07:27:05.875586 14664 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed5355a130a4576b98a4d9d18c63af6 (DEFAULT_TABLE table=test-table [id=56519873ad034e41b8788f8b4410e039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:05.875906 14664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed5355a130a4576b98a4d9d18c63af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.875806 14509 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed5355a130a4576b98a4d9d18c63af6 (DEFAULT_TABLE table=test-table [id=56519873ad034e41b8788f8b4410e039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:05.877658 14509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed5355a130a4576b98a4d9d18c63af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.880695 14765 tablet_bootstrap.cc:492] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Bootstrap starting.
I20260811 07:27:05.881081 14766 tablet_bootstrap.cc:492] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Bootstrap starting.
I20260811 07:27:05.881863 14765 tablet_bootstrap.cc:654] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.882143 14766 tablet_bootstrap.cc:654] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.883205 14765 tablet_bootstrap.cc:492] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: No bootstrap required, opened a new log
I20260811 07:27:05.883301 14765 ts_tablet_manager.cc:1397] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:05.883769 14765 raft_consensus.cc:348] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.883913 14765 raft_consensus.cc:374] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.883947 14765 raft_consensus.cc:729] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11e63f43a1448f9b080bba7b86164ea, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.884084 14765 consensus_queue.cc:260] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.884353 14765 ts_tablet_manager.cc:1428] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:05.875427 14351 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed5355a130a4576b98a4d9d18c63af6 (DEFAULT_TABLE table=test-table [id=56519873ad034e41b8788f8b4410e039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:05.885334 14351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed5355a130a4576b98a4d9d18c63af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:05.888448 14819 raft_consensus.cc:2229] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:05.888878 14818 raft_consensus.cc:2229] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:05.889385 14818 raft_consensus.cc:2258] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:05.889614 14819 raft_consensus.cc:2258] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:05.891152 14766 tablet_bootstrap.cc:492] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: No bootstrap required, opened a new log
I20260811 07:27:05.891294 14766 ts_tablet_manager.cc:1397] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260811 07:27:05.891623 14818 ts_tablet_manager.cc:1905] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:05.892205 14766 raft_consensus.cc:348] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.892392 14766 raft_consensus.cc:374] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.892452 14766 raft_consensus.cc:729] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.892596 14766 consensus_queue.cc:260] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.894603 14764 tablet_bootstrap.cc:492] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Bootstrap starting.
I20260811 07:27:05.895419 14818 ts_tablet_manager.cc:1918] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:05.895547 14818 log.cc:1196] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/25d23ad1d28046cc80276e99d1c9bf86
I20260811 07:27:05.895848 14764 tablet_bootstrap.cc:654] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:05.895934 14818 ts_tablet_manager.cc:1939] T 25d23ad1d28046cc80276e99d1c9bf86 P d11e63f43a1448f9b080bba7b86164ea: Deleting consensus metadata
I20260811 07:27:05.897451 14764 tablet_bootstrap.cc:492] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: No bootstrap required, opened a new log
I20260811 07:27:05.897482 14190 catalog_manager.cc:4841] TS d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223): tablet 25d23ad1d28046cc80276e99d1c9bf86 (table test-table [id=cef2e190a13d4eb595fb2d3491f22763]) successfully deleted
I20260811 07:27:05.897555 14764 ts_tablet_manager.cc:1397] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:05.898084 14764 raft_consensus.cc:348] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.898236 14764 raft_consensus.cc:374] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:05.898276 14764 raft_consensus.cc:729] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Initialized, Role: FOLLOWER
I20260811 07:27:05.898774 14764 consensus_queue.cc:260] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.899614 14764 ts_tablet_manager.cc:1428] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:27:05.903496 14766 ts_tablet_manager.cc:1428] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260811 07:27:05.905974 14819 ts_tablet_manager.cc:1905] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:05.908986 14770 raft_consensus.cc:482] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:05.909119 14770 raft_consensus.cc:504] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.909597 14819 ts_tablet_manager.cc:1918] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:05.909719 14819 log.cc:1196] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/25d23ad1d28046cc80276e99d1c9bf86
I20260811 07:27:05.910053 14819 ts_tablet_manager.cc:1939] T 25d23ad1d28046cc80276e99d1c9bf86 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting consensus metadata
I20260811 07:27:05.910424 14770 leader_election.cc:288] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905), d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223)
I20260811 07:27:05.911554 14190 catalog_manager.cc:4841] TS 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905): tablet 25d23ad1d28046cc80276e99d1c9bf86 (table test-table [id=cef2e190a13d4eb595fb2d3491f22763]) successfully deleted
I20260811 07:27:05.916005 14622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.910801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.11.248.3:32957)
0811 07:27:05.910929 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.910944 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.911042 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.912036 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.912040 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.912062 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.912178 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.912185 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.913292 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.913297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.914587 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.914601 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.915528 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.915532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.915650 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.915677 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.915760 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.915843 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 07:27:05.916555 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.911407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:32957 (local address 127.11.248.1:42905)
0811 07:27:05.911520 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.911524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.911539 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:05.911588 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.911591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.911639 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.911712 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.912318 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.913139 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.914750 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.915380 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.915509 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.915567 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.916293 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.916398 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 07:27:05.917083 14374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed5355a130a4576b98a4d9d18c63af6" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" is_pre_election: true
I20260811 07:27:05.917251 14374 raft_consensus.cc:2454] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 0.
I20260811 07:27:05.917709 14617 leader_election.cc:302] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, 8af44672ed4246d1be704d34d0c55915; no voters:
I20260811 07:27:05.918078 14770 raft_consensus.cc:2781] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:05.918145 14770 raft_consensus.cc:482] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:05.918197 14770 raft_consensus.cc:3037] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.919710 14770 raft_consensus.cc:504] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.920109 14770 leader_election.cc:288] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 election: Requested vote from peers 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905), d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223)
I20260811 07:27:05.920624 14374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed5355a130a4576b98a4d9d18c63af6" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53"
I20260811 07:27:05.920760 14374 raft_consensus.cc:3037] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.921967 14374 raft_consensus.cc:2454] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 1.
I20260811 07:27:05.922308 14617 leader_election.cc:302] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, 8af44672ed4246d1be704d34d0c55915; no voters:
I20260811 07:27:05.922508 14770 raft_consensus.cc:2781] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:05.922674 14770 raft_consensus.cc:686] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 1 LEADER]: Becoming Leader. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Running, Role: LEADER
I20260811 07:27:05.922927 14770 consensus_queue.cc:237] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:05.923043 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.911354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:60345 (local address 127.11.248.2:36223)
0811 07:27:05.911858 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.911863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.915907 (+ 4044us) server_negotiation.cc:407] Connection header received
0811 07:27:05.916433 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.916436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.916490 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.916539 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:05.917515 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.918307 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.921452 (+ 3145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.922068 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.922166 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.922225 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.922814 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.922909 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401}
I20260811 07:27:05.923653 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.911058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36223 (local address 127.11.248.3:60345)
0811 07:27:05.915812 (+ 4754us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.915828 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.915979 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.917018 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.917020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.917041 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:05.917377 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.917387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.918590 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.918595 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.921300 (+ 2705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.921312 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.922468 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.922474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.922623 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.922648 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.923410 (+ 762us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.923502 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4672,"thread_start_us":77,"threads_started":1}
I20260811 07:27:05.924431 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed5355a130a4576b98a4d9d18c63af6" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea" is_pre_election: true
I20260811 07:27:05.924486 14531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed5355a130a4576b98a4d9d18c63af6" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea"
I20260811 07:27:05.924571 14532 raft_consensus.cc:2454] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 0.
I20260811 07:27:05.925767 14205 catalog_manager.cc:5495] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8af44672ed4246d1be704d34d0c55915 (127.11.248.3). New cstate: current_term: 1 leader_uuid: "8af44672ed4246d1be704d34d0c55915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } health_report { overall_health: HEALTHY } } }
I20260811 07:27:05.944293 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.939777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50390 (local address 127.11.248.3:33361)
0811 07:27:05.939905 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.939910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.939926 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:05.940143 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.940149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.940263 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.940388 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.940678 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.941506 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.942463 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.942811 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.942919 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.943210 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.943832 (+ 622us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.943948 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.944061 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.944128 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:27:05.957149 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.953232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:39807 (local address 127.11.248.1:42905)
0811 07:27:05.953388 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.953392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.953407 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:05.953534 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.953536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.953594 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.953667 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.953991 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.954657 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.955949 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.956176 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.956272 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.956616 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.956698 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.956758 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.956978 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.957032 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:27:05.957149 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.953099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.11.248.3:39807)
0811 07:27:05.953302 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.953319 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.953423 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.953696 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.953698 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.953706 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:05.953844 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.953850 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.954799 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.954803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.955787 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.955799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.956303 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.956306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.956406 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.956467 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.956785 (+ 318us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.956791 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.956892 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.956988 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 07:27:05.964035 14531 raft_consensus.cc:3037] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:05.964223 14374 raft_consensus.cc:1261] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Refusing update from remote peer 8af44672ed4246d1be704d34d0c55915: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:05.964670 14770 consensus_queue.cc:1035] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:05.965473 14531 raft_consensus.cc:1261] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Refusing update from remote peer 8af44672ed4246d1be704d34d0c55915: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:05.965871 14770 consensus_queue.cc:1035] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:05.995520 14812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.991095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:33361 (local address 127.11.248.1:50559)
0811 07:27:05.991241 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:05.991257 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:05.991353 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:05.991939 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:05.991942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:05.991950 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:05.992082 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.992087 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.993221 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.993227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.994031 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:05.994044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.994625 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.994629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:05.994717 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.994753 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.995188 (+ 435us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.995196 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:27:05.995261 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 07:27:05.995370 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 07:27:05.995958 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:05.991370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50559 (local address 127.11.248.3:33361)
0811 07:27:05.991520 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:05.991525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:05.991559 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:27:05.991617 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:05.991620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:05.991672 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:05.991814 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:05.992277 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.993058 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.994168 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:05.994496 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:05.994630 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:05.994934 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:05.995027 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:05.995120 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:05.995760 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 07:27:05.995836 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 07:27:05.997009 14795 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:27:07.566213 14205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:07.566398 14205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:07.569170 14205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Sending DeleteTablet for 3 replicas of tablet 9ed5355a130a4576b98a4d9d18c63af6
I20260811 07:27:07.569850 14664 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed5355a130a4576b98a4d9d18c63af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:07 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:50376
I20260811 07:27:07.569867 14351 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed5355a130a4576b98a4d9d18c63af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:07 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:44616
I20260811 07:27:07.569931 14509 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed5355a130a4576b98a4d9d18c63af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:07 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:53854
I20260811 07:27:07.570398 14859 tablet_replica.cc:330] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: stopping tablet replica
I20260811 07:27:07.570607 14859 raft_consensus.cc:2229] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:07.570756 14859 raft_consensus.cc:2258] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:07.570920 14858 tablet_replica.cc:330] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: stopping tablet replica
I20260811 07:27:07.571090 14858 raft_consensus.cc:2229] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:07.571071 14860 tablet_replica.cc:330] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: stopping tablet replica
I20260811 07:27:07.571221 14858 raft_consensus.cc:2258] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:07.571301 14860 raft_consensus.cc:2229] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:07.571614 14860 raft_consensus.cc:2258] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:07.572304 14859 ts_tablet_manager.cc:1905] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:07.573975 14858 ts_tablet_manager.cc:1905] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:07.575470 14859 ts_tablet_manager.cc:1918] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:27:07.575616 14859 log.cc:1196] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/9ed5355a130a4576b98a4d9d18c63af6
I20260811 07:27:07.575800 14860 ts_tablet_manager.cc:1905] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:07.576079 14859 ts_tablet_manager.cc:1939] T 9ed5355a130a4576b98a4d9d18c63af6 P d11e63f43a1448f9b080bba7b86164ea: Deleting consensus metadata
I20260811 07:27:07.576964 14190 catalog_manager.cc:4841] TS d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223): tablet 9ed5355a130a4576b98a4d9d18c63af6 (table test-table [id=56519873ad034e41b8788f8b4410e039]) successfully deleted
I20260811 07:27:07.577566 14858 ts_tablet_manager.cc:1918] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:27:07.577656 14858 log.cc:1196] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/9ed5355a130a4576b98a4d9d18c63af6
I20260811 07:27:07.577962 14858 ts_tablet_manager.cc:1939] T 9ed5355a130a4576b98a4d9d18c63af6 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting consensus metadata
I20260811 07:27:07.578750 14860 ts_tablet_manager.cc:1918] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:27:07.578840 14860 log.cc:1196] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/9ed5355a130a4576b98a4d9d18c63af6
I20260811 07:27:07.578897 14190 catalog_manager.cc:4841] TS 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905): tablet 9ed5355a130a4576b98a4d9d18c63af6 (table test-table [id=56519873ad034e41b8788f8b4410e039]) successfully deleted
I20260811 07:27:07.579164 14860 ts_tablet_manager.cc:1939] T 9ed5355a130a4576b98a4d9d18c63af6 P 8af44672ed4246d1be704d34d0c55915: Deleting consensus metadata
I20260811 07:27:07.580029 14188 catalog_manager.cc:4841] TS 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361): tablet 9ed5355a130a4576b98a4d9d18c63af6 (table test-table [id=56519873ad034e41b8788f8b4410e039]) successfully deleted
Aug 11 07:27:07 dist-test-slave-77v9 krb5kdc[14154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433227, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:27:07 dist-test-slave-77v9 krb5kdc[14154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433227, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:07.603422 14868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:07.594084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47152 (local address 127.11.248.62:33007)
0811 07:27:07.594435 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:07.594445 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:07.594463 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:27:07.594608 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:07.594611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:07.594658 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:07.594757 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:07.595507 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.596087 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.597016 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.597259 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.597370 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:07.600001 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:07.600004 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:07.600006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:07.600035 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:07.601681 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:07.602117 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:07.602121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:07.602123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:07.602210 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:07.602495 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:07.602498 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:07.602500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:07.602698 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:07.602833 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:07.603090 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 07:27:07.603223 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":102,"threads_started":1}
I20260811 07:27:07.606524 14205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:07.607064 14205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:07.611845 14509 tablet_service.cc:1467] Processing CreateTablet for tablet 25163137e67e4dfe93e82768de75c912 (DEFAULT_TABLE table=test-table [id=7136c81ec1e94948b250911c85199460]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:07.612098 14664 tablet_service.cc:1467] Processing CreateTablet for tablet 25163137e67e4dfe93e82768de75c912 (DEFAULT_TABLE table=test-table [id=7136c81ec1e94948b250911c85199460]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:07.612216 14509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25163137e67e4dfe93e82768de75c912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:07.612167 14351 tablet_service.cc:1467] Processing CreateTablet for tablet 25163137e67e4dfe93e82768de75c912 (DEFAULT_TABLE table=test-table [id=7136c81ec1e94948b250911c85199460]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:07.612435 14351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25163137e67e4dfe93e82768de75c912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:07.612438 14664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25163137e67e4dfe93e82768de75c912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:07.614425 14869 tablet_bootstrap.cc:492] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Bootstrap starting.
I20260811 07:27:07.615229 14870 tablet_bootstrap.cc:492] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Bootstrap starting.
I20260811 07:27:07.615376 14869 tablet_bootstrap.cc:654] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:07.616153 14870 tablet_bootstrap.cc:654] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:07.616663 14869 tablet_bootstrap.cc:492] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: No bootstrap required, opened a new log
I20260811 07:27:07.616793 14869 ts_tablet_manager.cc:1397] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:07.616858 14871 tablet_bootstrap.cc:492] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Bootstrap starting.
I20260811 07:27:07.617368 14869 raft_consensus.cc:348] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.617528 14869 raft_consensus.cc:374] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:07.617563 14869 raft_consensus.cc:729] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11e63f43a1448f9b080bba7b86164ea, State: Initialized, Role: FOLLOWER
I20260811 07:27:07.617705 14869 consensus_queue.cc:260] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.617805 14871 tablet_bootstrap.cc:654] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:07.617664 14870 tablet_bootstrap.cc:492] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: No bootstrap required, opened a new log
I20260811 07:27:07.618119 14870 ts_tablet_manager.cc:1397] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:07.618211 14869 ts_tablet_manager.cc:1428] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:27:07.618793 14870 raft_consensus.cc:348] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.618965 14870 raft_consensus.cc:374] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:07.619057 14870 raft_consensus.cc:729] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Initialized, Role: FOLLOWER
I20260811 07:27:07.619100 14871 tablet_bootstrap.cc:492] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: No bootstrap required, opened a new log
I20260811 07:27:07.619195 14871 ts_tablet_manager.cc:1397] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:27:07.619280 14870 consensus_queue.cc:260] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.619596 14870 ts_tablet_manager.cc:1428] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:07.619640 14871 raft_consensus.cc:348] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.619743 14871 raft_consensus.cc:374] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:07.619771 14871 raft_consensus.cc:729] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Initialized, Role: FOLLOWER
I20260811 07:27:07.619908 14871 consensus_queue.cc:260] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.620188 14871 ts_tablet_manager.cc:1428] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:07.877067 14835 raft_consensus.cc:482] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:07.877269 14835 raft_consensus.cc:504] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.877854 14835 leader_election.cc:288] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223), 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361)
I20260811 07:27:07.878396 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25163137e67e4dfe93e82768de75c912" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea" is_pre_election: true
I20260811 07:27:07.878451 14689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25163137e67e4dfe93e82768de75c912" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af44672ed4246d1be704d34d0c55915" is_pre_election: true
I20260811 07:27:07.878553 14532 raft_consensus.cc:2454] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 0.
I20260811 07:27:07.878648 14689 raft_consensus.cc:2454] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 0.
I20260811 07:27:07.878898 14306 leader_election.cc:302] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, d11e63f43a1448f9b080bba7b86164ea; no voters:
I20260811 07:27:07.879086 14835 raft_consensus.cc:2781] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:07.879135 14835 raft_consensus.cc:482] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:07.879177 14835 raft_consensus.cc:3037] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:07.880709 14835 raft_consensus.cc:504] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.881214 14835 leader_election.cc:288] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 election: Requested vote from peers d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223), 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361)
I20260811 07:27:07.881629 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25163137e67e4dfe93e82768de75c912" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea"
I20260811 07:27:07.881753 14532 raft_consensus.cc:3037] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:07.882746 14532 raft_consensus.cc:2454] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 1.
I20260811 07:27:07.883092 14306 leader_election.cc:302] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, d11e63f43a1448f9b080bba7b86164ea; no voters:
I20260811 07:27:07.883068 14689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25163137e67e4dfe93e82768de75c912" candidate_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8af44672ed4246d1be704d34d0c55915"
I20260811 07:27:07.883205 14689 raft_consensus.cc:3037] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:07.883291 14835 raft_consensus.cc:2781] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:07.883414 14835 raft_consensus.cc:686] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 LEADER]: Becoming Leader. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Running, Role: LEADER
I20260811 07:27:07.883579 14835 consensus_queue.cc:237] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.884446 14689 raft_consensus.cc:2454] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dcb55dfcfa0457d8a5da3b1007cfc53 in term 1.
I20260811 07:27:07.885581 14204 catalog_manager.cc:5495] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1). New cstate: current_term: 1 leader_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } health_report { overall_health: UNKNOWN } } }
I20260811 07:27:07.923415 14879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:07.919864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.11.248.1:42905)
0811 07:27:07.920219 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:07.920228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:07.920240 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:27:07.920282 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:07.920284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:07.920336 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:07.920438 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:07.920721 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.921367 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.922267 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.922508 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.922621 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:07.922916 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:07.922995 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:07.923075 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:07.923172 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 07:27:07.923229 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":140,"threads_started":1}
I20260811 07:27:07.933493 14879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:07.930192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:47521 (local address 127.11.248.1:42905)
0811 07:27:07.930323 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:07.930326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:07.930516 (+ 190us) server_negotiation.cc:407] Connection header received
0811 07:27:07.930655 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:07.930657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:07.930700 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:07.930766 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:07.931044 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.931537 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.932448 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.932658 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.932739 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:07.933070 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:07.933153 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:07.933210 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:07.933289 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:27:07.933337 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:27:07.933504 14883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:07.930052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.11.248.1:47521)
0811 07:27:07.930428 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:07.930441 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:07.930537 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:07.930826 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:07.930829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:07.930836 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:07.930940 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:07.930945 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.931648 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.931650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:07.932286 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:07.932295 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:07.932761 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:07.932763 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:07.932934 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:07.932965 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:07.933226 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:07.933231 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:27:07.933282 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 07:27:07.933375 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":193,"threads_started":1}
I20260811 07:27:07.940439 14689 raft_consensus.cc:1261] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Refusing update from remote peer 7dcb55dfcfa0457d8a5da3b1007cfc53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:07.940439 14532 raft_consensus.cc:1261] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Refusing update from remote peer 7dcb55dfcfa0457d8a5da3b1007cfc53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:07.940935 14835 consensus_queue.cc:1035] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:07.941123 14840 consensus_queue.cc:1035] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:07.977641 14204 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:07.977865 14204 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:07.980327 14204 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Sending DeleteTablet for 3 replicas of tablet 25163137e67e4dfe93e82768de75c912
I20260811 07:27:07.981068 14664 tablet_service.cc:1514] Processing DeleteTablet for tablet 25163137e67e4dfe93e82768de75c912 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:07 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:50376
I20260811 07:27:07.981068 14509 tablet_service.cc:1514] Processing DeleteTablet for tablet 25163137e67e4dfe93e82768de75c912 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:07 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:53854
I20260811 07:27:07.981200 14353 tablet_service.cc:1514] Processing DeleteTablet for tablet 25163137e67e4dfe93e82768de75c912 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:07 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:44616
I20260811 07:27:07.981280 14860 tablet_replica.cc:330] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: stopping tablet replica
I20260811 07:27:07.981385 14858 tablet_replica.cc:330] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: stopping tablet replica
I20260811 07:27:07.981420 14860 raft_consensus.cc:2229] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:07.981500 14858 raft_consensus.cc:2229] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:07.981597 14860 raft_consensus.cc:2258] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:07.981781 14859 tablet_replica.cc:330] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: stopping tablet replica
I20260811 07:27:07.981840 14858 raft_consensus.cc:2258] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:07.981907 14859 raft_consensus.cc:2229] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:07.982035 14859 raft_consensus.cc:2258] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:07.982290 14204 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:07.982786 14204 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:07.983212 14858 ts_tablet_manager.cc:1905] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:07.984413 14860 ts_tablet_manager.cc:1905] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:07.986816 14860 ts_tablet_manager.cc:1918] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:07.986900 14860 log.cc:1196] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/25163137e67e4dfe93e82768de75c912
I20260811 07:27:07.987167 14860 ts_tablet_manager.cc:1939] T 25163137e67e4dfe93e82768de75c912 P 8af44672ed4246d1be704d34d0c55915: Deleting consensus metadata
I20260811 07:27:07.987416 14858 ts_tablet_manager.cc:1918] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:07.987565 14858 log.cc:1196] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/25163137e67e4dfe93e82768de75c912
I20260811 07:27:07.987907 14858 ts_tablet_manager.cc:1939] T 25163137e67e4dfe93e82768de75c912 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Deleting consensus metadata
I20260811 07:27:07.987877 14188 catalog_manager.cc:4841] TS 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361): tablet 25163137e67e4dfe93e82768de75c912 (table test-table [id=7136c81ec1e94948b250911c85199460]) successfully deleted
I20260811 07:27:07.988706 14190 catalog_manager.cc:4841] TS 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905): tablet 25163137e67e4dfe93e82768de75c912 (table test-table [id=7136c81ec1e94948b250911c85199460]) successfully deleted
I20260811 07:27:07.992159 14509 tablet_service.cc:1467] Processing CreateTablet for tablet 708e6a17fe6c47f7b0c07aa20e5b9075 (DEFAULT_TABLE table=test-table [id=507407d784804fa095ea612a37bb0dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:07.992288 14664 tablet_service.cc:1467] Processing CreateTablet for tablet 708e6a17fe6c47f7b0c07aa20e5b9075 (DEFAULT_TABLE table=test-table [id=507407d784804fa095ea612a37bb0dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:07.992355 14859 ts_tablet_manager.cc:1905] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:07.992457 14509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 708e6a17fe6c47f7b0c07aa20e5b9075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:07.992589 14664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 708e6a17fe6c47f7b0c07aa20e5b9075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:07.995182 14870 tablet_bootstrap.cc:492] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Bootstrap starting.
I20260811 07:27:07.995182 14859 ts_tablet_manager.cc:1918] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:07.995241 14869 tablet_bootstrap.cc:492] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Bootstrap starting.
I20260811 07:27:07.995924 14870 tablet_bootstrap.cc:654] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:07.996237 14869 tablet_bootstrap.cc:654] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:07.997102 14870 tablet_bootstrap.cc:492] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: No bootstrap required, opened a new log
I20260811 07:27:07.997218 14870 ts_tablet_manager.cc:1397] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:07.997502 14869 tablet_bootstrap.cc:492] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: No bootstrap required, opened a new log
I20260811 07:27:07.997594 14869 ts_tablet_manager.cc:1397] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:27:07.997617 14870 raft_consensus.cc:348] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.997761 14870 raft_consensus.cc:374] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:07.997800 14870 raft_consensus.cc:729] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Initialized, Role: FOLLOWER
I20260811 07:27:07.997953 14870 consensus_queue.cc:260] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.997983 14869 raft_consensus.cc:348] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.998098 14869 raft_consensus.cc:374] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:07.998134 14869 raft_consensus.cc:729] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11e63f43a1448f9b080bba7b86164ea, State: Initialized, Role: FOLLOWER
I20260811 07:27:07.998253 14870 ts_tablet_manager.cc:1428] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:07.998260 14869 consensus_queue.cc:260] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:07.998512 14869 ts_tablet_manager.cc:1428] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:27:07.999483 14353 tablet_service.cc:1467] Processing CreateTablet for tablet 708e6a17fe6c47f7b0c07aa20e5b9075 (DEFAULT_TABLE table=test-table [id=507407d784804fa095ea612a37bb0dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:07.995262 14859 log.cc:1196] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/25163137e67e4dfe93e82768de75c912
I20260811 07:27:07.999825 14353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 708e6a17fe6c47f7b0c07aa20e5b9075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:07.999940 14859 ts_tablet_manager.cc:1939] T 25163137e67e4dfe93e82768de75c912 P d11e63f43a1448f9b080bba7b86164ea: Deleting consensus metadata
I20260811 07:27:08.000598 14190 catalog_manager.cc:4841] TS d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223): tablet 25163137e67e4dfe93e82768de75c912 (table test-table [id=7136c81ec1e94948b250911c85199460]) successfully deleted
I20260811 07:27:08.002393 14871 tablet_bootstrap.cc:492] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Bootstrap starting.
I20260811 07:27:08.003182 14871 tablet_bootstrap.cc:654] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:08.004520 14871 tablet_bootstrap.cc:492] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53: No bootstrap required, opened a new log
I20260811 07:27:08.004629 14871 ts_tablet_manager.cc:1397] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:08.005111 14871 raft_consensus.cc:348] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:08.005203 14871 raft_consensus.cc:374] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:08.005223 14871 raft_consensus.cc:729] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dcb55dfcfa0457d8a5da3b1007cfc53, State: Initialized, Role: FOLLOWER
I20260811 07:27:08.005318 14871 consensus_queue.cc:260] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:08.005519 14871 ts_tablet_manager.cc:1428] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:27:08.306120 14850 raft_consensus.cc:482] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:08.306269 14850 raft_consensus.cc:504] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:08.306742 14850 leader_election.cc:288] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905), d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223)
I20260811 07:27:08.307359 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "708e6a17fe6c47f7b0c07aa20e5b9075" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea" is_pre_election: true
I20260811 07:27:08.307359 14374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "708e6a17fe6c47f7b0c07aa20e5b9075" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" is_pre_election: true
I20260811 07:27:08.307528 14532 raft_consensus.cc:2454] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 0.
I20260811 07:27:08.307528 14374 raft_consensus.cc:2454] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 0.
I20260811 07:27:08.307858 14617 leader_election.cc:302] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, 8af44672ed4246d1be704d34d0c55915; no voters:
I20260811 07:27:08.308046 14850 raft_consensus.cc:2781] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:08.308109 14850 raft_consensus.cc:482] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:08.308158 14850 raft_consensus.cc:3037] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:08.309319 14850 raft_consensus.cc:504] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:08.309656 14850 leader_election.cc:288] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 election: Requested vote from peers 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905), d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223)
I20260811 07:27:08.310115 14374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "708e6a17fe6c47f7b0c07aa20e5b9075" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53"
I20260811 07:27:08.310115 14532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "708e6a17fe6c47f7b0c07aa20e5b9075" candidate_uuid: "8af44672ed4246d1be704d34d0c55915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d11e63f43a1448f9b080bba7b86164ea"
I20260811 07:27:08.310262 14374 raft_consensus.cc:3037] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:08.310276 14532 raft_consensus.cc:3037] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:08.311458 14532 raft_consensus.cc:2454] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 1.
I20260811 07:27:08.311458 14374 raft_consensus.cc:2454] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8af44672ed4246d1be704d34d0c55915 in term 1.
I20260811 07:27:08.311780 14617 leader_election.cc:302] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dcb55dfcfa0457d8a5da3b1007cfc53, 8af44672ed4246d1be704d34d0c55915; no voters:
I20260811 07:27:08.311980 14850 raft_consensus.cc:2781] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:08.312222 14850 raft_consensus.cc:686] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 1 LEADER]: Becoming Leader. State: Replica: 8af44672ed4246d1be704d34d0c55915, State: Running, Role: LEADER
I20260811 07:27:08.312528 14850 consensus_queue.cc:237] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } }
I20260811 07:27:08.314373 14204 catalog_manager.cc:5495] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8af44672ed4246d1be704d34d0c55915 (127.11.248.3). New cstate: current_term: 1 leader_uuid: "8af44672ed4246d1be704d34d0c55915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8af44672ed4246d1be704d34d0c55915" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 33361 } health_report { overall_health: HEALTHY } } }
I20260811 07:27:08.380239 14894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:08.376935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50396 (local address 127.11.248.3:33361)
0811 07:27:08.377258 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:08.377276 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:08.377289 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:27:08.377343 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:08.377345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:08.377385 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:08.377475 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:08.377728 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:08.378264 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:08.379097 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:08.379351 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:08.379462 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:08.379707 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:08.379791 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:08.379871 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:08.379998 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 07:27:08.380057 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":118,"threads_started":1}
I20260811 07:27:08.387245 14532 raft_consensus.cc:1261] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Refusing update from remote peer 8af44672ed4246d1be704d34d0c55915: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:08.387319 14374 raft_consensus.cc:1261] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Refusing update from remote peer 8af44672ed4246d1be704d34d0c55915: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:08.387712 14892 consensus_queue.cc:1035] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d11e63f43a1448f9b080bba7b86164ea" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:08.387880 14850 consensus_queue.cc:1035] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dcb55dfcfa0457d8a5da3b1007cfc53" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:27:08.402611 14836 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:27:09.957803 14201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:09.958027 14201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:09.961084 14201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b27abde4191461dab57e8311e285078: Sending DeleteTablet for 3 replicas of tablet 708e6a17fe6c47f7b0c07aa20e5b9075
I20260811 07:27:09.961724 14353 tablet_service.cc:1514] Processing DeleteTablet for tablet 708e6a17fe6c47f7b0c07aa20e5b9075 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:09 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:44616
I20260811 07:27:09.961772 14509 tablet_service.cc:1514] Processing DeleteTablet for tablet 708e6a17fe6c47f7b0c07aa20e5b9075 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:09 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:53854
I20260811 07:27:09.961756 14664 tablet_service.cc:1514] Processing DeleteTablet for tablet 708e6a17fe6c47f7b0c07aa20e5b9075 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:09 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:50376
I20260811 07:27:09.962244 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 14285
I20260811 07:27:09.962265 14927 tablet_replica.cc:330] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53: stopping tablet replica
I20260811 07:27:09.962440 14927 raft_consensus.cc:2229] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:09.962577 14927 raft_consensus.cc:2258] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 7dcb55dfcfa0457d8a5da3b1007cfc53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:09.964486 14929 tablet_replica.cc:330] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: stopping tablet replica
I20260811 07:27:09.964745 14929 raft_consensus.cc:2229] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:09.964949 14929 raft_consensus.cc:2258] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:09.965569 14928 tablet_replica.cc:330] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: stopping tablet replica
I20260811 07:27:09.965739 14928 raft_consensus.cc:2229] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:09.965957 14928 raft_consensus.cc:2258] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:09.966827 14928 ts_tablet_manager.cc:1905] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:09.970584 14928 ts_tablet_manager.cc:1918] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:27:09.970690 14928 log.cc:1196] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/708e6a17fe6c47f7b0c07aa20e5b9075
I20260811 07:27:09.971057 14928 ts_tablet_manager.cc:1939] T 708e6a17fe6c47f7b0c07aa20e5b9075 P 8af44672ed4246d1be704d34d0c55915: Deleting consensus metadata
I20260811 07:27:09.971571 14929 ts_tablet_manager.cc:1905] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:09.971889 14188 catalog_manager.cc:4841] TS 8af44672ed4246d1be704d34d0c55915 (127.11.248.3:33361): tablet 708e6a17fe6c47f7b0c07aa20e5b9075 (table test-table [id=507407d784804fa095ea612a37bb0dc3]) successfully deleted
I20260811 07:27:09.973953 14929 ts_tablet_manager.cc:1918] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:27:09.974071 14929 log.cc:1196] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/708e6a17fe6c47f7b0c07aa20e5b9075
I20260811 07:27:09.974342 14929 ts_tablet_manager.cc:1939] T 708e6a17fe6c47f7b0c07aa20e5b9075 P d11e63f43a1448f9b080bba7b86164ea: Deleting consensus metadata
I20260811 07:27:09.975113 14190 catalog_manager.cc:4841] TS d11e63f43a1448f9b080bba7b86164ea (127.11.248.2:36223): tablet 708e6a17fe6c47f7b0c07aa20e5b9075 (table test-table [id=507407d784804fa095ea612a37bb0dc3]) successfully deleted
W20260811 07:27:09.976938 14190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:42905 (error 108)
I20260811 07:27:09.977102 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 14441
I20260811 07:27:09.982254 14932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:09.981552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42905 (local address 127.0.0.1:60978)
0811 07:27:09.981980 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:09.982089 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:42905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":196,"threads_started":1}
W20260811 07:27:09.982476 14190 catalog_manager.cc:4584] TS 7dcb55dfcfa0457d8a5da3b1007cfc53 (127.11.248.1:42905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 708e6a17fe6c47f7b0c07aa20e5b9075: Network error: Client connection negotiation failed: client connection to 127.11.248.1:42905: connect: Connection refused (error 111)
I20260811 07:27:09.987329 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 14595
I20260811 07:27:09.998255 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 14169
2026-08-11T07:27:10Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6849 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:10 dist-test-slave-77v9 krb5kdc[14935](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:10 dist-test-slave-77v9 krb5kdc[14935](info): set up 2 sockets
Aug 11 07:27:10 dist-test-slave-77v9 krb5kdc[14935](info): commencing operation
krb5kdc: starting...
W20260811 07:27:11.152283 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:11 dist-test-slave-77v9 krb5kdc[14935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:11.300619 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46847
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:46847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:11.415184 14952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:11.415568 14952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:11.415649 14952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:11.419773 14952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:11.419881 14952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:11.419920 14952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:11.419975 14952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:11.420008 14952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:11.425519 14952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:46847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:11.427022 14952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:11.428488 14952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:11.440096 14958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:11.440127 14960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:11.440336 14952 server_base.cc:1034] running on GCE node
W20260811 07:27:11.440127 14962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:11.441037 14952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:11.442270 14952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:11.443431 14952 hybrid_clock.cc:648] HybridClock initialized: now 1786433231443413 us; error 31 us; skew 500 ppm
Aug 11 07:27:11 dist-test-slave-77v9 krb5kdc[14935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:11.446508 14952 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:11.447520 14952 webserver.cc:460] Webserver started at http://127.11.248.62:42281/ using document root <none> and password file <none>
I20260811 07:27:11.448173 14952 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:11.448257 14952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:11.448510 14952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:11.450747 14952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "0ad29133aef04aa0b07ac20d50a9e25d"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "979a11d8c14192e054624d6cc88e9697"
server_key_iv: "ac9bd559e7b5fa512e173f0656bc07d4"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.451365 14952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "0ad29133aef04aa0b07ac20d50a9e25d"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "979a11d8c14192e054624d6cc88e9697"
server_key_iv: "ac9bd559e7b5fa512e173f0656bc07d4"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.455411 14952 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:11.457957 14972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:11.459163 14952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:11.459326 14952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "0ad29133aef04aa0b07ac20d50a9e25d"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "979a11d8c14192e054624d6cc88e9697"
server_key_iv: "ac9bd559e7b5fa512e173f0656bc07d4"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.459446 14952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:11.485579 14952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:11.488724 14952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:11.489010 14952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:11.497170 14952 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:46847
I20260811 07:27:11.497221 15031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:46847 every 8 connection(s)
I20260811 07:27:11.498219 14952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:11.498881 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 14952
I20260811 07:27:11.499043 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:11.499357 12256 external_mini_cluster.cc:1428] Setting key bdb03bf2eb6bb8ca7e486746e2a4bcbd
I20260811 07:27:11.501529 15032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:11.508193 15032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d: Bootstrap starting.
Aug 11 07:27:11 dist-test-slave-77v9 krb5kdc[14935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:11.510869 15032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:11.511650 15032 log.cc:824] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:11.514608 15032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d: No bootstrap required, opened a new log
I20260811 07:27:11.515630 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:11.501039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57988 (local address 127.11.248.62:46847)
0811 07:27:11.501542 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:11.501560 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:11.501626 (+ 66us) server_negotiation.cc:407] Connection header received
0811 07:27:11.502375 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:11.502394 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:11.502750 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:11.503070 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:11.504050 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:11.505270 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:11.506492 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:11.507082 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:11.507217 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:11.510296 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:11.510301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:11.510314 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:11.510345 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:11.512352 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:11.513004 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:11.513011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:11.513018 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:11.513203 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:11.513564 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:11.513567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:11.513568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:11.514026 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:11.514185 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:11.514554 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 07:27:11.514878 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":172,"threads_started":1}
I20260811 07:27:11.519084 15032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46847 } }
I20260811 07:27:11.519340 15032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:11.519439 15032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad29133aef04aa0b07ac20d50a9e25d, State: Initialized, Role: FOLLOWER
I20260811 07:27:11.520001 15032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46847 } }
I20260811 07:27:11.520162 15032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:11.520298 15032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:11.520401 15032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:11.521589 15032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46847 } }
I20260811 07:27:11.521970 15032 leader_election.cc:302] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ad29133aef04aa0b07ac20d50a9e25d; no voters:
I20260811 07:27:11.522374 15032 leader_election.cc:288] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:11.522502 15038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:11.522790 15038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [term 1 LEADER]: Becoming Leader. State: Replica: 0ad29133aef04aa0b07ac20d50a9e25d, State: Running, Role: LEADER
I20260811 07:27:11.523118 15038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46847 } }
I20260811 07:27:11.523720 15032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:11.524938 15042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ad29133aef04aa0b07ac20d50a9e25d. Latest consensus state: current_term: 1 leader_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46847 } } }
I20260811 07:27:11.525097 15042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:11.525401 15041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad29133aef04aa0b07ac20d50a9e25d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46847 } } }
I20260811 07:27:11.525542 15041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:11.525516 15050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:11.528901 15050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:11.534901 15050 catalog_manager.cc:1347] Generated new cluster ID: 998589dd87564cda91f8210a71b241f1
I20260811 07:27:11.534981 15050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:11.546818 15050 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:11.547812 15050 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:11.560223 15050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ad29133aef04aa0b07ac20d50a9e25d: Generated new TSK 0
I20260811 07:27:11.561257 15050 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:11.600114 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46847
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:11.721226 15064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:11.721527 15064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:11.721572 15064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:11.725966 15064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:11.726042 15064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:11.726131 15064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:11.731841 15064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:11.733047 15064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:11.734145 15064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:11.744814 15072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:11.744890 15070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:11.744923 15069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:11.745378 15064 server_base.cc:1034] running on GCE node
I20260811 07:27:11.745878 15064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:11.746592 15064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:11.747846 15064 hybrid_clock.cc:648] HybridClock initialized: now 1786433231747826 us; error 34 us; skew 500 ppm
Aug 11 07:27:11 dist-test-slave-77v9 krb5kdc[14935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:11.751075 15064 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:11.752018 15064 webserver.cc:460] Webserver started at http://127.11.248.1:33621/ using document root <none> and password file <none>
I20260811 07:27:11.752606 15064 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:11.752684 15064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:11.752954 15064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:11.755115 15064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "1af244c39bcb4f939fb43ea686f45e70"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "48e0fcaa1ebe52ad20ff820a841b86ac"
server_key_iv: "fa8ced40f199135700d45effe20a5799"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.755656 15064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "1af244c39bcb4f939fb43ea686f45e70"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "48e0fcaa1ebe52ad20ff820a841b86ac"
server_key_iv: "fa8ced40f199135700d45effe20a5799"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.759564 15064 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:11.762130 15081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:11.763471 15064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:11.763609 15064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "1af244c39bcb4f939fb43ea686f45e70"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "48e0fcaa1ebe52ad20ff820a841b86ac"
server_key_iv: "fa8ced40f199135700d45effe20a5799"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.763727 15064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:11.781433 15064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:11.784907 15064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:11.785133 15064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:11.785795 15064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:11.786720 15064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:11.786798 15064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:11.786875 15064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:11.786917 15064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:11.796238 15064 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:37035
I20260811 07:27:11.796269 15208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:37035 every 8 connection(s)
I20260811 07:27:11.797326 15064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:11.798096 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15064
I20260811 07:27:11.798245 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:11.798534 12256 external_mini_cluster.cc:1428] Setting key 62cad680349478870ad5a820ae31ac86
Aug 11 07:27:11 dist-test-slave-77v9 krb5kdc[14935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:27:11.814059 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:11.799412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50775 (local address 127.11.248.62:46847)
0811 07:27:11.799554 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:11.799558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:11.800647 (+ 1089us) server_negotiation.cc:407] Connection header received
0811 07:27:11.802026 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:11.802032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:11.802096 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:11.802207 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:11.804045 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:11.804605 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:11.806632 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:11.806924 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:11.807019 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:11.810295 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:11.810297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:11.810300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:11.810327 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:11.811746 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:11.812333 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:11.812336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:11.812343 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:11.812423 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:11.812781 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:11.812784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:11.812786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:11.813044 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:11.813150 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:11.813715 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 07:27:11.813919 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:11.815328 15211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:11.799961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:46847 (local address 127.11.248.1:50775)
0811 07:27:11.800470 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:11.800527 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:11.801804 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:11.802548 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:11.802559 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:11.803101 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:11.803850 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:11.803874 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:11.804757 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:11.804761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:11.806473 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:11.806490 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:11.807143 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:11.807151 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:11.807432 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:11.808151 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:11.808174 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:11.810092 (+ 1918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:11.811917 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:11.811929 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:11.811945 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:11.812212 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:11.812519 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:11.812523 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:11.812526 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:11.812675 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:11.813151 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:11.813159 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:11.813427 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 07:27:11.813628 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 07:27:11.814047 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":139,"threads_started":1}
I20260811 07:27:11.816705 15209 heartbeater.cc:347] Connected to a master server at 127.11.248.62:46847
I20260811 07:27:11.817022 15209 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:11.817555 15209 heartbeater.cc:511] Master 127.11.248.62:46847 requested a full tablet report, sending...
I20260811 07:27:11.819260 14992 ts_manager.cc:194] Registered new tserver with Master: 1af244c39bcb4f939fb43ea686f45e70 (127.11.248.1:37035)
I20260811 07:27:11.821069 14992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:50775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:11.836190 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46847
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:11.953020 15214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:11.953318 15214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:11.953398 15214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:11.957762 15214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:11.957849 15214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:11.957913 15214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:11.964299 15214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:11.965538 15214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:11.966629 15214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:11.977027 15220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:11.977031 15219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:11.977027 15222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:11.977420 15214 server_base.cc:1034] running on GCE node
I20260811 07:27:11.977864 15214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:11.978536 15214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:11.979698 15214 hybrid_clock.cc:648] HybridClock initialized: now 1786433231979659 us; error 53 us; skew 500 ppm
Aug 11 07:27:11 dist-test-slave-77v9 krb5kdc[14935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:11.982664 15214 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:11.983575 15214 webserver.cc:460] Webserver started at http://127.11.248.2:36633/ using document root <none> and password file <none>
I20260811 07:27:11.984108 15214 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:11.984166 15214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:11.984329 15214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:11.986428 15214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "b0f5d568bcf04e7f90467922c48cfdaf"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "e6bdfc3a29b39a96ab3da05797724264"
server_key_iv: "412539299586912f67d144a4110069b8"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.986980 15214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "b0f5d568bcf04e7f90467922c48cfdaf"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "e6bdfc3a29b39a96ab3da05797724264"
server_key_iv: "412539299586912f67d144a4110069b8"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.990849 15214 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:11.993544 15231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:11.994818 15214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:11.994961 15214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "b0f5d568bcf04e7f90467922c48cfdaf"
format_stamp: "Formatted at 2026-08-11 07:27:11 on dist-test-slave-77v9"
server_key: "e6bdfc3a29b39a96ab3da05797724264"
server_key_iv: "412539299586912f67d144a4110069b8"
server_key_version: "encryptionkey@0"
I20260811 07:27:11.995081 15214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:12.019917 15214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:12.023221 15214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:12.023439 15214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:12.024211 15214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:12.025236 15214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:12.025315 15214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:12.025380 15214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:12.025413 15214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:12.034777 15214 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:37405
I20260811 07:27:12.034832 15359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:37405 every 8 connection(s)
I20260811 07:27:12.035737 15214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:12.044524 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15214
I20260811 07:27:12.044636 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:12.045006 12256 external_mini_cluster.cc:1428] Setting key cc97d6100399b0bc81178a7dbd58684e
Aug 11 07:27:12 dist-test-slave-77v9 krb5kdc[14935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433231, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:12.051102 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:12.037731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:52129 (local address 127.11.248.62:46847)
0811 07:27:12.037867 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:12.037872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:12.038684 (+ 812us) server_negotiation.cc:407] Connection header received
0811 07:27:12.040051 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:12.040055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:12.040120 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:12.040228 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:12.041557 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.042094 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.043260 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.043502 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.043618 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:12.046682 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:12.046686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:12.046688 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:12.046719 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:12.048710 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:12.049393 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:12.049397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:12.049399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:12.049490 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:12.049873 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:12.049877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:12.049879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:12.050076 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:12.050185 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:12.050769 (+ 584us) server_negotiation.cc:299] Negotiation successful
0811 07:27:12.050922 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:27:12.051970 15362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:12.038080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:46847 (local address 127.11.248.2:52129)
0811 07:27:12.038534 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:12.038579 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:12.039806 (+ 1227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:12.040413 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:12.040420 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:12.040874 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:12.041402 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:12.041417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.042224 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.042234 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:12.043131 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:12.043140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.043668 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.043672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:12.043848 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:12.044504 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:12.044521 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:12.046387 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:12.048915 (+ 2528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:12.048922 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:12.048941 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:12.049251 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:12.049589 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:12.049592 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:12.049594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:12.049757 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:12.050186 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:12.050194 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:12.050503 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 07:27:12.050709 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 07:27:12.051070 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
I20260811 07:27:12.053443 15360 heartbeater.cc:347] Connected to a master server at 127.11.248.62:46847
I20260811 07:27:12.053738 15360 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:12.054322 15360 heartbeater.cc:511] Master 127.11.248.62:46847 requested a full tablet report, sending...
I20260811 07:27:12.055526 14992 ts_manager.cc:194] Registered new tserver with Master: b0f5d568bcf04e7f90467922c48cfdaf (127.11.248.2:37405)
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:12.056409 14992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:52129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:12.078275 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46847
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:12.194082 15365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:12.194363 15365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:12.194409 15365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:12.198567 15365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:12.198647 15365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:12.198712 15365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:12.204191 15365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:12.205468 15365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:12.206501 15365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:12.216715 15376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:12.216732 15371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:12.216724 15373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:12.216883 15365 server_base.cc:1034] running on GCE node
I20260811 07:27:12.217382 15365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:12.218227 15365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:12.219460 15365 hybrid_clock.cc:648] HybridClock initialized: now 1786433232219442 us; error 33 us; skew 500 ppm
Aug 11 07:27:12 dist-test-slave-77v9 krb5kdc[14935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433232, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:12.222471 15365 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:12.223515 15365 webserver.cc:460] Webserver started at http://127.11.248.3:40293/ using document root <none> and password file <none>
I20260811 07:27:12.224095 15365 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:12.224159 15365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:12.224426 15365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:12.226742 15365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "709596babb214c3ab8e458f9f8fe719d"
format_stamp: "Formatted at 2026-08-11 07:27:12 on dist-test-slave-77v9"
server_key: "b9e6e575f41e6d5dcc3789e6be1c7d49"
server_key_iv: "438faf01ddda03d9f7f308dca73da737"
server_key_version: "encryptionkey@0"
I20260811 07:27:12.227348 15365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "709596babb214c3ab8e458f9f8fe719d"
format_stamp: "Formatted at 2026-08-11 07:27:12 on dist-test-slave-77v9"
server_key: "b9e6e575f41e6d5dcc3789e6be1c7d49"
server_key_iv: "438faf01ddda03d9f7f308dca73da737"
server_key_version: "encryptionkey@0"
I20260811 07:27:12.231262 15365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:12.233762 15383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:12.235069 15365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:12.235216 15365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "709596babb214c3ab8e458f9f8fe719d"
format_stamp: "Formatted at 2026-08-11 07:27:12 on dist-test-slave-77v9"
server_key: "b9e6e575f41e6d5dcc3789e6be1c7d49"
server_key_iv: "438faf01ddda03d9f7f308dca73da737"
server_key_version: "encryptionkey@0"
I20260811 07:27:12.235329 15365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:12.253937 15365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:12.257318 15365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:12.257530 15365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:12.258176 15365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:12.259037 15365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:12.259085 15365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:12.259148 15365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:12.259183 15365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:12.268966 15365 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:41675
I20260811 07:27:12.268989 15514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:41675 every 8 connection(s)
I20260811 07:27:12.269927 15365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:12.276329 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15365
I20260811 07:27:12.276489 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:12.276852 12256 external_mini_cluster.cc:1428] Setting key 93cccf5fde344777e61da3cc94365763
Aug 11 07:27:12 dist-test-slave-77v9 krb5kdc[14935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433232, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:12.283834 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:12.271838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:37379 (local address 127.11.248.62:46847)
0811 07:27:12.272015 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:12.272020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:12.273163 (+ 1143us) server_negotiation.cc:407] Connection header received
0811 07:27:12.274025 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:12.274028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:12.274078 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:12.274165 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:12.275329 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.275874 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.277225 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.277452 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.277544 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:12.280427 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:12.280430 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:12.280433 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:12.280466 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:12.281758 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:12.282280 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:12.282284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:12.282286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:12.282367 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:12.282708 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:12.282712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:12.282714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:12.282911 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:12.283014 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:12.283532 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 07:27:12.283663 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:27:12.284642 15517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:12.272265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:46847 (local address 127.11.248.3:37379)
0811 07:27:12.273014 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:12.273059 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:12.273813 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:12.274342 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:12.274348 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:12.274708 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:12.275184 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:12.275197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.275991 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.275994 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:12.277100 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:12.277110 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:12.277612 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:12.277621 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:12.277796 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:12.278521 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:12.278541 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:12.280253 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:12.281892 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:12.281898 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:12.281914 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:12.282175 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:12.282456 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:12.282460 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:12.282462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:12.282614 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:12.283026 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:12.283035 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:12.283280 (+ 245us) client_negotiation.cc:769] Sending connection context
0811 07:27:12.283492 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 07:27:12.283816 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":113,"threads_started":1}
I20260811 07:27:12.285861 15515 heartbeater.cc:347] Connected to a master server at 127.11.248.62:46847
I20260811 07:27:12.286141 15515 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:12.286666 15515 heartbeater.cc:511] Master 127.11.248.62:46847 requested a full tablet report, sending...
I20260811 07:27:12.287665 14992 ts_manager.cc:194] Registered new tserver with Master: 709596babb214c3ab8e458f9f8fe719d (127.11.248.3:41675)
I20260811 07:27:12.288233 14992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:37379
I20260811 07:27:12.291055 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:27:12.306229 15036 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:12.304567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57994 (local address 127.11.248.62:46847)
0811 07:27:12.304708 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:12.304713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:12.305033 (+ 320us) server_negotiation.cc:407] Connection header received
0811 07:27:12.305090 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:12.305092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:12.305140 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:12.305228 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:12.306071 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57994: BlockingRecv error: recv got EOF from 127.0.0.1:57994 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:27:12.307615 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15064
I20260811 07:27:12.319159 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15214
I20260811 07:27:12.327772 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15365
I20260811 07:27:12.336186 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 14952
2026-08-11T07:27:12Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2331 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:12 dist-test-slave-77v9 krb5kdc[15529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:12 dist-test-slave-77v9 krb5kdc[15529](info): set up 2 sockets
Aug 11 07:27:12 dist-test-slave-77v9 krb5kdc[15529](info): commencing operation
krb5kdc: starting...
W20260811 07:27:13.523358 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:13 dist-test-slave-77v9 krb5kdc[15529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:13.672765 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39017
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:39017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:13.794219 15542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:13.794545 15542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:13.794591 15542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:13.798954 15542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:13.799052 15542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:13.799072 15542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:13.799089 15542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:13.799106 15542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:13.804737 15542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:39017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:13.806039 15542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:13.807107 15542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:13.816511 15547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:13.816511 15551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:13.816515 15548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:13.817116 15542 server_base.cc:1034] running on GCE node
I20260811 07:27:13.817673 15542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:13.818840 15542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:13.820047 15542 hybrid_clock.cc:648] HybridClock initialized: now 1786433233820028 us; error 47 us; skew 500 ppm
Aug 11 07:27:13 dist-test-slave-77v9 krb5kdc[15529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:13.823272 15542 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:13.824400 15542 webserver.cc:460] Webserver started at http://127.11.248.62:44847/ using document root <none> and password file <none>
I20260811 07:27:13.825083 15542 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:13.825186 15542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:13.825462 15542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:13.827729 15542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "d1324e885c7345bd838dd3f0f350ee18"
format_stamp: "Formatted at 2026-08-11 07:27:13 on dist-test-slave-77v9"
server_key: "e22936e41a9c4a9c636654730a419e5b"
server_key_iv: "6084d9e97362525ab541d6f192aa0d18"
server_key_version: "encryptionkey@0"
I20260811 07:27:13.828353 15542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "d1324e885c7345bd838dd3f0f350ee18"
format_stamp: "Formatted at 2026-08-11 07:27:13 on dist-test-slave-77v9"
server_key: "e22936e41a9c4a9c636654730a419e5b"
server_key_iv: "6084d9e97362525ab541d6f192aa0d18"
server_key_version: "encryptionkey@0"
I20260811 07:27:13.832571 15542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 07:27:13.835289 15559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:13.836689 15542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:13.836995 15542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "d1324e885c7345bd838dd3f0f350ee18"
format_stamp: "Formatted at 2026-08-11 07:27:13 on dist-test-slave-77v9"
server_key: "e22936e41a9c4a9c636654730a419e5b"
server_key_iv: "6084d9e97362525ab541d6f192aa0d18"
server_key_version: "encryptionkey@0"
I20260811 07:27:13.837132 15542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:13.863698 15542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:13.867326 15542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:13.867588 15542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:13.875862 15542 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:39017
I20260811 07:27:13.875890 15618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:39017 every 8 connection(s)
I20260811 07:27:13.876967 15542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:13.879905 15619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:13.881722 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15542
I20260811 07:27:13.881855 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:13.882202 12256 external_mini_cluster.cc:1428] Setting key c8031cce30b660b6494c7e59206bb471
I20260811 07:27:13.886763 15619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18: Bootstrap starting.
I20260811 07:27:13.889436 15619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:13.890209 15619 log.cc:824] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:27:13 dist-test-slave-77v9 krb5kdc[15529](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:13.893030 15619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18: No bootstrap required, opened a new log
I20260811 07:27:13.896530 15619 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1324e885c7345bd838dd3f0f350ee18" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39017 } }
I20260811 07:27:13.896878 15619 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:13.896979 15619 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1324e885c7345bd838dd3f0f350ee18, State: Initialized, Role: FOLLOWER
I20260811 07:27:13.897599 15619 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1324e885c7345bd838dd3f0f350ee18" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39017 } }
I20260811 07:27:13.897809 15619 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:13.897913 15619 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:13.898054 15619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:13.899348 15619 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1324e885c7345bd838dd3f0f350ee18" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39017 } }
I20260811 07:27:13.899760 15619 leader_election.cc:302] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1324e885c7345bd838dd3f0f350ee18; no voters:
I20260811 07:27:13.900066 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:13.883781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57464 (local address 127.11.248.62:39017)
0811 07:27:13.884300 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:13.884317 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:13.884354 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:27:13.885120 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:13.885139 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:13.885487 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:13.885844 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:13.886798 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:13.887902 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:13.889114 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:13.889673 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:13.889848 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:13.893353 (+ 3505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:13.893360 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:13.893376 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:13.893409 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:13.896144 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:13.896765 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:13.896771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:13.896776 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:13.897029 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:13.897495 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:13.897499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:13.897501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:13.898071 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:13.898394 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:13.898705 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 07:27:13.899108 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":151,"threads_started":1}
I20260811 07:27:13.900189 15619 leader_election.cc:288] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:13.900306 15624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:13.900586 15624 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [term 1 LEADER]: Becoming Leader. State: Replica: d1324e885c7345bd838dd3f0f350ee18, State: Running, Role: LEADER
I20260811 07:27:13.900987 15624 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1324e885c7345bd838dd3f0f350ee18" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39017 } }
I20260811 07:27:13.901757 15619 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:13.903023 15626 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1324e885c7345bd838dd3f0f350ee18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1324e885c7345bd838dd3f0f350ee18" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39017 } } }
I20260811 07:27:13.903155 15626 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:13.903491 15625 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1324e885c7345bd838dd3f0f350ee18. Latest consensus state: current_term: 1 leader_uuid: "d1324e885c7345bd838dd3f0f350ee18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1324e885c7345bd838dd3f0f350ee18" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39017 } } }
I20260811 07:27:13.903579 15625 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:13.904603 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:27:13.904661 15628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:13.908401 15628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:13.915409 15628 catalog_manager.cc:1347] Generated new cluster ID: 623c323c77ec4f12b5f67c0ef68ea405
I20260811 07:27:13.915515 15628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:13.924108 15628 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:13.925473 15628 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:13.931149 15628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1324e885c7345bd838dd3f0f350ee18: Generated new TSK 0
I20260811 07:27:13.931634 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:13.924794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57478 (local address 127.11.248.62:39017)
0811 07:27:13.924930 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:13.924935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:13.925334 (+ 399us) server_negotiation.cc:407] Connection header received
0811 07:27:13.925495 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:13.925501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:13.925558 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:13.925661 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:13.926503 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:13.927467 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:13.928748 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:13.929233 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:13.929361 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:13.930413 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:13.930418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:13.930421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:13.931087 (+ 666us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:13.931129 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:13.931154 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:13.931261 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:13.931421 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 07:27:13.931497 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":67}
I20260811 07:27:13.932054 15628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:13.945681 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15542
2026-08-11T07:27:13Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1608 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:14 dist-test-slave-77v9 krb5kdc[15653](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:14 dist-test-slave-77v9 krb5kdc[15653](info): set up 2 sockets
Aug 11 07:27:14 dist-test-slave-77v9 krb5kdc[15653](info): commencing operation
krb5kdc: starting...
W20260811 07:27:15.069916 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:15.221454 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43123
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:43123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:15.345144 15670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:15.345598 15670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:15.345676 15670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:15.350323 15670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:15.350414 15670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:15.350435 15670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:15.350455 15670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:15.350471 15670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:15.356698 15670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:43123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:15.358031 15670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:15.359220 15670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:15.369215 15676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:15.369266 15678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:15.369215 15675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:15.369680 15670 server_base.cc:1034] running on GCE node
I20260811 07:27:15.370388 15670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:15.371780 15670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:15.372997 15670 hybrid_clock.cc:648] HybridClock initialized: now 1786433235372978 us; error 39 us; skew 500 ppm
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:15.380915 15670 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:15.382068 15670 webserver.cc:460] Webserver started at http://127.11.248.62:44421/ using document root <none> and password file <none>
I20260811 07:27:15.382755 15670 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:15.382866 15670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:15.383131 15670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:15.385659 15670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "0c76b42429694b1c800d0f4cac75832b"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "1c26ebe1c94c491e6d7ba56ccb9a31f8"
server_key_iv: "84a98ae8cb4251957607dda237450580"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.386422 15670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "0c76b42429694b1c800d0f4cac75832b"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "1c26ebe1c94c491e6d7ba56ccb9a31f8"
server_key_iv: "84a98ae8cb4251957607dda237450580"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.391305 15670 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:27:15.394610 15686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.396418 15670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:27:15.396660 15670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "0c76b42429694b1c800d0f4cac75832b"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "1c26ebe1c94c491e6d7ba56ccb9a31f8"
server_key_iv: "84a98ae8cb4251957607dda237450580"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.396925 15670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:15.417877 15670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:15.421665 15670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:15.421926 15670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:15.430962 15670 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:43123
I20260811 07:27:15.431290 15742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:43123 every 8 connection(s)
I20260811 07:27:15.432525 15670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:15.436686 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:15.441150 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15670
I20260811 07:27:15.441288 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:15.441593 12256 external_mini_cluster.cc:1428] Setting key 360cc1cbe366633447518f46e1b01bd2
I20260811 07:27:15.444169 15743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b: Bootstrap starting.
I20260811 07:27:15.447548 15743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:15.448658 15743 log.cc:824] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:15.451411 15743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b: No bootstrap required, opened a new log
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:15.455952 15743 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c76b42429694b1c800d0f4cac75832b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43123 } }
I20260811 07:27:15.456326 15743 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:15.456499 15743 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c76b42429694b1c800d0f4cac75832b, State: Initialized, Role: FOLLOWER
I20260811 07:27:15.457139 15743 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c76b42429694b1c800d0f4cac75832b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43123 } }
I20260811 07:27:15.457345 15743 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:15.457422 15743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:15.457528 15743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:15.458650 15743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c76b42429694b1c800d0f4cac75832b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43123 } }
I20260811 07:27:15.459105 15743 leader_election.cc:302] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c76b42429694b1c800d0f4cac75832b; no voters:
I20260811 07:27:15.459522 15743 leader_election.cc:288] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:15.459656 15748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:15.459856 15748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [term 1 LEADER]: Becoming Leader. State: Replica: 0c76b42429694b1c800d0f4cac75832b, State: Running, Role: LEADER
I20260811 07:27:15.460098 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:15.443307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.11.248.62:43123)
0811 07:27:15.443870 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:15.443901 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:15.443952 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:27:15.444953 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:15.444980 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:15.445456 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:15.445920 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:15.446733 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.448354 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.449615 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.450419 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.450606 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:15.453453 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:15.453461 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:15.453481 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:15.453522 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:15.456357 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:15.457009 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:15.457016 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:15.457022 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:15.457189 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:15.457573 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:15.457576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:15.457577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:15.458108 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:15.458365 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:15.458701 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 07:27:15.459040 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":168,"threads_started":1}
I20260811 07:27:15.460189 15748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c76b42429694b1c800d0f4cac75832b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43123 } }
I20260811 07:27:15.461019 15743 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:15.461558 15748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c76b42429694b1c800d0f4cac75832b. Latest consensus state: current_term: 1 leader_uuid: "0c76b42429694b1c800d0f4cac75832b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c76b42429694b1c800d0f4cac75832b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43123 } } }
I20260811 07:27:15.461690 15748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:15.462473 15749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c76b42429694b1c800d0f4cac75832b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c76b42429694b1c800d0f4cac75832b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43123 } } }
I20260811 07:27:15.462576 15749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:15.463011 15754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:15.467846 15754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:15.474625 15754 catalog_manager.cc:1347] Generated new cluster ID: fdec8035a6524d2ab8ae97cbff1e32af
I20260811 07:27:15.474733 15754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:15.489241 15754 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:15.490604 15754 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:15.498567 15754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c76b42429694b1c800d0f4cac75832b: Generated new TSK 0
I20260811 07:27:15.499631 15754 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:15.540311 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43123
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:15.662815 15773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:15.663154 15773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:15.663230 15773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:15.667604 15773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:15.667698 15773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:15.667797 15773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:15.674026 15773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:15.675202 15773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:15.676296 15773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:15.686753 15781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:15.686784 15779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:15.686784 15778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:15.687274 15773 server_base.cc:1034] running on GCE node
I20260811 07:27:15.687757 15773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:15.688521 15773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:15.689719 15773 hybrid_clock.cc:648] HybridClock initialized: now 1786433235689683 us; error 58 us; skew 500 ppm
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:15.692708 15773 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:15.693792 15773 webserver.cc:460] Webserver started at http://127.11.248.1:45617/ using document root <none> and password file <none>
I20260811 07:27:15.694445 15773 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:15.694551 15773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:15.694810 15773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:15.697183 15773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "df26a24ac50b4d869104469655c3caaa"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "61e96f87cd8358895093596c45fc0cc2"
server_key_iv: "c71fb48be6fb64e72e84faa411a6e40a"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.697839 15773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "df26a24ac50b4d869104469655c3caaa"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "61e96f87cd8358895093596c45fc0cc2"
server_key_iv: "c71fb48be6fb64e72e84faa411a6e40a"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.702224 15773 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 07:27:15.705119 15790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.706601 15773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:15.706753 15773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "df26a24ac50b4d869104469655c3caaa"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "61e96f87cd8358895093596c45fc0cc2"
server_key_iv: "c71fb48be6fb64e72e84faa411a6e40a"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.706885 15773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:15.731230 15773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:15.734947 15773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:15.735186 15773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:15.735846 15773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:15.736769 15773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:15.736872 15773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.736965 15773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:15.736991 15773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.746387 15773 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:41147
I20260811 07:27:15.746429 15920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:41147 every 8 connection(s)
I20260811 07:27:15.747382 15773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:15.749199 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15773
I20260811 07:27:15.749351 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:15.749735 12256 external_mini_cluster.cc:1428] Setting key 4bc345ade7a972a37ab973466fd626e8
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:27:15.764614 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:15.749549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:51345 (local address 127.11.248.62:43123)
0811 07:27:15.749719 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:15.749724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:15.750687 (+ 963us) server_negotiation.cc:407] Connection header received
0811 07:27:15.752291 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:15.752298 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:15.752362 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:15.752473 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:15.754164 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.754707 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.756607 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.757004 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.757114 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:15.760322 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:15.760326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:15.760328 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:15.760365 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:15.762092 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:15.762753 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:15.762757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:15.762759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:15.762850 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:15.763226 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:15.763230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:15.763232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:15.763447 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:15.763560 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:15.764215 (+ 655us) server_negotiation.cc:299] Negotiation successful
0811 07:27:15.764360 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:27:15.765647 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:15.749999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43123 (local address 127.11.248.1:51345)
0811 07:27:15.750497 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:15.750573 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:15.752057 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:15.752683 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:15.752691 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:15.753220 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:15.753980 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:15.754005 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.754849 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.754856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:15.756408 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:15.756424 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.757209 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.757215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:15.757449 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:15.758164 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:15.758191 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:15.760120 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:15.762223 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:15.762229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:15.762249 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:15.762620 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:15.762956 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:15.762959 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:15.762961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:15.763122 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:15.763559 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:15.763568 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:15.763951 (+ 383us) client_negotiation.cc:769] Sending connection context
0811 07:27:15.764162 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 07:27:15.764539 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":119,"threads_started":1}
I20260811 07:27:15.768478 15922 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43123
I20260811 07:27:15.768790 15922 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:15.769657 15922 heartbeater.cc:511] Master 127.11.248.62:43123 requested a full tablet report, sending...
I20260811 07:27:15.771788 15705 ts_manager.cc:194] Registered new tserver with Master: df26a24ac50b4d869104469655c3caaa (127.11.248.1:41147)
I20260811 07:27:15.773684 15705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:51345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:15.786580 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43123
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:15.906610 15927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:15.906929 15927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:15.906976 15927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:15.911355 15927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:15.911444 15927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:15.911509 15927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:15.917395 15927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:15.918670 15927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:15.919781 15927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:15.930310 15932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:15.930310 15936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:15.930330 15934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:15.930401 15927 server_base.cc:1034] running on GCE node
I20260811 07:27:15.931104 15927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:15.931856 15927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:15.933059 15927 hybrid_clock.cc:648] HybridClock initialized: now 1786433235933042 us; error 30 us; skew 500 ppm
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:15.936125 15927 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:15.937129 15927 webserver.cc:460] Webserver started at http://127.11.248.2:38855/ using document root <none> and password file <none>
I20260811 07:27:15.937693 15927 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:15.937758 15927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:15.937950 15927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:15.940071 15927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "9325ab57fd734c6b97da166fbe4edc0c"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "298af3e4daa243e610aa5b392694953d"
server_key_iv: "3466ace90ac2cd9b485e9e2b6ba349fe"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.940629 15927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "9325ab57fd734c6b97da166fbe4edc0c"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "298af3e4daa243e610aa5b392694953d"
server_key_iv: "3466ace90ac2cd9b485e9e2b6ba349fe"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.944670 15927 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:27:15.947512 15945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.949070 15927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:15.949196 15927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "9325ab57fd734c6b97da166fbe4edc0c"
format_stamp: "Formatted at 2026-08-11 07:27:15 on dist-test-slave-77v9"
server_key: "298af3e4daa243e610aa5b392694953d"
server_key_iv: "3466ace90ac2cd9b485e9e2b6ba349fe"
server_key_version: "encryptionkey@0"
I20260811 07:27:15.949301 15927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:15.961865 15927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:15.965615 15927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:15.965855 15927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:15.966542 15927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:15.967581 15927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:15.967633 15927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.967700 15927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:15.967744 15927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:15.977756 15927 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:33161
I20260811 07:27:15.977838 16074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:33161 every 8 connection(s)
I20260811 07:27:15.978790 15927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:15.985107 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 15927
I20260811 07:27:15.985294 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:15.985610 12256 external_mini_cluster.cc:1428] Setting key 03a0d9cef08869cc3a8071130cbebf17
Aug 11 07:27:15 dist-test-slave-77v9 krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433235, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:15.995218 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:15.980963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:60343 (local address 127.11.248.62:43123)
0811 07:27:15.981130 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:15.981134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:15.982041 (+ 907us) server_negotiation.cc:407] Connection header received
0811 07:27:15.983578 (+ 1537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:15.983581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:15.983648 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:15.983760 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:15.985153 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.985848 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.987228 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.987540 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.987669 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:15.990455 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:15.990459 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:15.990461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:15.990487 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:15.992302 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:15.993109 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:15.993113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:15.993114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:15.993202 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:15.993689 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:15.993692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:15.993693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:15.993923 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:15.994033 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:15.994920 (+ 887us) server_negotiation.cc:299] Negotiation successful
0811 07:27:15.995070 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:27:15.996467 16077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:15.981368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43123 (local address 127.11.248.2:60343)
0811 07:27:15.981861 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:15.981907 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:15.983309 (+ 1402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:15.983975 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:15.983982 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:15.984383 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:15.984997 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:15.985013 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.986010 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.986017 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:15.987093 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:15.987105 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:15.987717 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:15.987721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:15.987874 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:15.988556 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:15.988573 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:15.990253 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:15.992436 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:15.992448 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:15.992472 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:15.992967 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:15.993311 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:15.993315 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:15.993317 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:15.993532 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:15.994069 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:15.994080 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:15.994493 (+ 413us) client_negotiation.cc:769] Sending connection context
0811 07:27:15.994753 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 07:27:15.995257 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":131,"threads_started":1}
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:15.998021 16075 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43123
I20260811 07:27:15.998365 16075 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:15.999023 16075 heartbeater.cc:511] Master 127.11.248.62:43123 requested a full tablet report, sending...
I20260811 07:27:16.000289 15705 ts_manager.cc:194] Registered new tserver with Master: 9325ab57fd734c6b97da166fbe4edc0c (127.11.248.2:33161)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:27:16.001257 15705 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:60343
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:16.022454 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43123
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:39839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:16.163439 16081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:16.163740 16081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:16.163789 16081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:16.168210 16081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:16.168295 16081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:16.168360 16081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:16.174302 16081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:16.175829 16081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:16.176964 16081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:16.187191 16087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:16.187191 16086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:16.187253 16089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:16.187749 16081 server_base.cc:1034] running on GCE node
I20260811 07:27:16.188200 16081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:16.188957 16081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:16.190150 16081 hybrid_clock.cc:648] HybridClock initialized: now 1786433236190123 us; error 53 us; skew 500 ppm
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433236, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:16.193382 16081 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:16.194820 16081 webserver.cc:460] Webserver started at http://127.11.248.3:35959/ using document root <none> and password file <none>
I20260811 07:27:16.195652 16081 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:16.195883 16081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:16.196189 16081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:16.199761 16081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "0732ab185dc04e0eb1e6bc9709b11250"
format_stamp: "Formatted at 2026-08-11 07:27:16 on dist-test-slave-77v9"
server_key: "312ee3c729908c53dfaf4e380f6cb458"
server_key_iv: "2c777447129d1c8db4b1ecf29a0b1a5a"
server_key_version: "encryptionkey@0"
I20260811 07:27:16.200680 16081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "0732ab185dc04e0eb1e6bc9709b11250"
format_stamp: "Formatted at 2026-08-11 07:27:16 on dist-test-slave-77v9"
server_key: "312ee3c729908c53dfaf4e380f6cb458"
server_key_iv: "2c777447129d1c8db4b1ecf29a0b1a5a"
server_key_version: "encryptionkey@0"
I20260811 07:27:16.207082 16081 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:27:16.211151 16098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:16.213002 16081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:16.213177 16081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "0732ab185dc04e0eb1e6bc9709b11250"
format_stamp: "Formatted at 2026-08-11 07:27:16 on dist-test-slave-77v9"
server_key: "312ee3c729908c53dfaf4e380f6cb458"
server_key_iv: "2c777447129d1c8db4b1ecf29a0b1a5a"
server_key_version: "encryptionkey@0"
I20260811 07:27:16.213351 16081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:16.253070 16081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:16.257970 16081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:16.258216 16081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:16.259090 16081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:16.260479 16081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:16.260553 16081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:16.260623 16081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:16.260663 16081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:16.274922 16081 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:38399
I20260811 07:27:16.274933 16233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:38399 every 8 connection(s)
I20260811 07:27:16.276417 16081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:16.282301 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16081
I20260811 07:27:16.282467 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:16.282845 12256 external_mini_cluster.cc:1428] Setting key 1b04c9ed03baa679f585641225469e72
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433236, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:16.292689 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:16.278586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:51573 (local address 127.11.248.62:43123)
0811 07:27:16.278775 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:16.278782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:16.279610 (+ 828us) server_negotiation.cc:407] Connection header received
0811 07:27:16.281121 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:16.281127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:16.281204 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:16.281336 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:16.282652 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:16.283318 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:16.285345 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:16.285572 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:16.285655 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:16.288834 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:16.288839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:16.288841 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:16.288871 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:16.290480 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:16.291050 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:16.291054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:16.291056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:16.291146 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:16.291507 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:16.291512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:16.291514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:16.291721 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:16.291832 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:16.292381 (+ 549us) server_negotiation.cc:299] Negotiation successful
0811 07:27:16.292519 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:27:16.293630 16236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:16.278928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43123 (local address 127.11.248.3:51573)
0811 07:27:16.279424 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:16.279482 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:16.280871 (+ 1389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:16.281484 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:16.281491 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:16.281874 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:16.282468 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:16.282489 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:16.283487 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:16.283494 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:16.285163 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:16.285178 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:16.285733 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:16.285739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:16.285988 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:16.286729 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:16.286756 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:16.288619 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:16.290623 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:16.290630 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:16.290648 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:16.290935 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:16.291244 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:16.291248 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:16.291250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:16.291403 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:16.291829 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:16.291836 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:16.292121 (+ 285us) client_negotiation.cc:769] Sending connection context
0811 07:27:16.292326 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 07:27:16.292697 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":143,"threads_started":1}
I20260811 07:27:16.294936 16234 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43123
I20260811 07:27:16.295207 16234 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:16.295830 16234 heartbeater.cc:511] Master 127.11.248.62:43123 requested a full tablet report, sending...
I20260811 07:27:16.297089 15704 ts_manager.cc:194] Registered new tserver with Master: 0732ab185dc04e0eb1e6bc9709b11250 (127.11.248.3:38399)
I20260811 07:27:16.297721 15704 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:51573
I20260811 07:27:16.309547 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433236, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433236, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:16.341235 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:16.331947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49542 (local address 127.11.248.62:43123)
0811 07:27:16.332104 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:16.332108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:16.332243 (+ 135us) server_negotiation.cc:407] Connection header received
0811 07:27:16.332369 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:16.332372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:16.332420 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:16.332509 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:16.333403 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:16.333981 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:16.334810 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:16.335048 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:16.335133 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:16.337950 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:16.337953 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:16.337955 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:16.337988 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:16.339379 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:16.339795 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:16.339798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:16.339799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:16.339917 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:16.340160 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:16.340162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:16.340164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:16.340405 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:16.340512 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:16.340958 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 07:27:16.341093 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 07:27:16.341693 15704 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49542
I20260811 07:27:16.342695 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15773
I20260811 07:27:16.355243 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15927
I20260811 07:27:16.363608 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16081
I20260811 07:27:16.371248 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 15670
2026-08-11T07:27:16Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2429 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[16248](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[16248](info): set up 2 sockets
Aug 11 07:27:16 dist-test-slave-77v9 krb5kdc[16248](info): commencing operation
krb5kdc: starting...
W20260811 07:27:17.527611 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:17 dist-test-slave-77v9 krb5kdc[16248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:17.677078 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:40271
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:40271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:17.798394 16265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:17.798728 16265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:17.798772 16265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:17.803169 16265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:17.803269 16265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:17.803290 16265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:17.803308 16265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:17.803330 16265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:17.809278 16265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:40271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:40271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:17.810654 16265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:17.811846 16265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:17.821336 16272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:17.821336 16273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:17.821332 16276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:17.821872 16265 server_base.cc:1034] running on GCE node
I20260811 07:27:17.822533 16265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:17.823817 16265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:17.825016 16265 hybrid_clock.cc:648] HybridClock initialized: now 1786433237824989 us; error 47 us; skew 500 ppm
Aug 11 07:27:17 dist-test-slave-77v9 krb5kdc[16248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:17.828326 16265 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:17.829471 16265 webserver.cc:460] Webserver started at http://127.11.248.62:40575/ using document root <none> and password file <none>
I20260811 07:27:17.830062 16265 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:17.830128 16265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:17.830308 16265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:17.832582 16265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "cb4effe298d14a448908a2b53d0acca3"
format_stamp: "Formatted at 2026-08-11 07:27:17 on dist-test-slave-77v9"
server_key: "b1ef495346284b31ebc08ea90be2abe2"
server_key_iv: "c7633e6c25cec26eb8e3b103fc5d9abb"
server_key_version: "encryptionkey@0"
I20260811 07:27:17.833252 16265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "cb4effe298d14a448908a2b53d0acca3"
format_stamp: "Formatted at 2026-08-11 07:27:17 on dist-test-slave-77v9"
server_key: "b1ef495346284b31ebc08ea90be2abe2"
server_key_iv: "c7633e6c25cec26eb8e3b103fc5d9abb"
server_key_version: "encryptionkey@0"
I20260811 07:27:17.837585 16265 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:17.840767 16284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:17.842430 16265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:27:17.842586 16265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "cb4effe298d14a448908a2b53d0acca3"
format_stamp: "Formatted at 2026-08-11 07:27:17 on dist-test-slave-77v9"
server_key: "b1ef495346284b31ebc08ea90be2abe2"
server_key_iv: "c7633e6c25cec26eb8e3b103fc5d9abb"
server_key_version: "encryptionkey@0"
I20260811 07:27:17.842708 16265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:17.865772 16265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:17.869642 16265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:17.869959 16265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:17.878564 16265 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:40271
I20260811 07:27:17.878590 16344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:40271 every 8 connection(s)
I20260811 07:27:17.879673 16265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:17.882894 16345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:17.886811 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16265
I20260811 07:27:17.887010 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:17.887351 12256 external_mini_cluster.cc:1428] Setting key 9bc563796c02611bc1eaa48321c881c8
I20260811 07:27:17.890149 16345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3: Bootstrap starting.
I20260811 07:27:17.893400 16345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:17.894651 16345 log.cc:824] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:17.897790 16345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3: No bootstrap required, opened a new log
Aug 11 07:27:17 dist-test-slave-77v9 krb5kdc[16248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:17.904153 16345 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4effe298d14a448908a2b53d0acca3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40271 } }
I20260811 07:27:17.904551 16345 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:17.904623 16345 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4effe298d14a448908a2b53d0acca3, State: Initialized, Role: FOLLOWER
I20260811 07:27:17.905239 16345 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4effe298d14a448908a2b53d0acca3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40271 } }
I20260811 07:27:17.905450 16345 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:17.905531 16345 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:17.905645 16345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:17.907408 16345 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4effe298d14a448908a2b53d0acca3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40271 } }
I20260811 07:27:17.907847 16345 leader_election.cc:302] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4effe298d14a448908a2b53d0acca3; no voters:
I20260811 07:27:17.908138 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:17.889327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40432 (local address 127.11.248.62:40271)
0811 07:27:17.889871 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:17.889890 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:17.889930 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:27:17.890746 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:17.890767 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:17.891161 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:17.891494 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:17.892606 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:17.894584 (+ 1978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:17.896039 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:17.897008 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:17.897250 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:17.901638 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:17.901650 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:17.901676 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:17.901727 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:17.904052 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:17.904900 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:17.904907 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:17.904914 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:17.905115 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:17.905527 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:17.905535 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:17.905541 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:17.906150 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:17.906364 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:17.906791 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 07:27:17.907138 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":176,"threads_started":1}
I20260811 07:27:17.908285 16345 leader_election.cc:288] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:17.908378 16350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:17.908566 16350 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [term 1 LEADER]: Becoming Leader. State: Replica: cb4effe298d14a448908a2b53d0acca3, State: Running, Role: LEADER
I20260811 07:27:17.908926 16350 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4effe298d14a448908a2b53d0acca3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40271 } }
I20260811 07:27:17.909732 16345 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:17.911777 16352 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb4effe298d14a448908a2b53d0acca3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4effe298d14a448908a2b53d0acca3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40271 } } }
I20260811 07:27:17.911978 16352 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:17.912254 16351 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4effe298d14a448908a2b53d0acca3. Latest consensus state: current_term: 1 leader_uuid: "cb4effe298d14a448908a2b53d0acca3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4effe298d14a448908a2b53d0acca3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40271 } } }
I20260811 07:27:17.912736 16351 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3 [sys.catalog]: This master's current role is: LEADER
W20260811 07:27:17.914950 16367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:27:17.915063 16367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:27:17.915139 16365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:17.915903 16365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:17.922398 16365 catalog_manager.cc:1347] Generated new cluster ID: 3152d163f92345abba206cba4675ed16
I20260811 07:27:17.922513 16365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:17.938542 16365 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:17.939710 16365 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:17.946154 16365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb4effe298d14a448908a2b53d0acca3: Generated new TSK 0
I20260811 07:27:17.947072 16365 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:17.984125 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:40271
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:18.107755 16372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:18.108100 16372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:18.108147 16372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:18.113003 16372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:18.113090 16372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:18.113155 16372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:18.119102 16372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:40271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:18.120414 16372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:18.121675 16372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:18.132567 16377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:18.132539 16380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:18.132572 16378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:18.132937 16372 server_base.cc:1034] running on GCE node
I20260811 07:27:18.133538 16372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:18.134274 16372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:18.135494 16372 hybrid_clock.cc:648] HybridClock initialized: now 1786433238135474 us; error 35 us; skew 500 ppm
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:18.138723 16372 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:18.139765 16372 webserver.cc:460] Webserver started at http://127.11.248.1:35771/ using document root <none> and password file <none>
I20260811 07:27:18.140384 16372 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:18.140492 16372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:18.140743 16372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:18.142998 16372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "9e3f95bda8af4704b31bcdfb8d931345"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "5a6568c9e47fc521aee2d0ce043996bd"
server_key_iv: "f9f09f34893ab6e62d9fcf332d670a45"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.143613 16372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "9e3f95bda8af4704b31bcdfb8d931345"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "5a6568c9e47fc521aee2d0ce043996bd"
server_key_iv: "f9f09f34893ab6e62d9fcf332d670a45"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.148555 16372 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:27:18.151543 16388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.153079 16372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:18.153257 16372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "9e3f95bda8af4704b31bcdfb8d931345"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "5a6568c9e47fc521aee2d0ce043996bd"
server_key_iv: "f9f09f34893ab6e62d9fcf332d670a45"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.153417 16372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:18.167353 16372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:18.170692 16372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:18.170929 16372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:18.171576 16372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:18.172518 16372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:18.172587 16372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.172662 16372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:18.172708 16372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.182325 16516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:42435 every 8 connection(s)
I20260811 07:27:18.182341 16372 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:42435
I20260811 07:27:18.183384 16372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:18.192750 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16372
I20260811 07:27:18.192993 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:18.193336 12256 external_mini_cluster.cc:1428] Setting key 704f42e3ce55ef0b84c8fae42e13bc97
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:18.198956 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.185411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:35935 (local address 127.11.248.62:40271)
0811 07:27:18.185568 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:18.185572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:18.186448 (+ 876us) server_negotiation.cc:407] Connection header received
0811 07:27:18.187903 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:18.187906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:18.187956 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:18.188036 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:18.189396 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.190003 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.191139 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.191376 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.191457 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.194511 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:18.194516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:18.194519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:18.194544 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:18.196184 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.196970 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.196972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.196974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.197056 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.197564 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.197569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.197572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.197853 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:18.198043 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:18.198641 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 07:27:18.198807 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:27:18.199889 16521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.185801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:40271 (local address 127.11.248.1:35935)
0811 07:27:18.186280 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:18.186327 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:18.187664 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:18.188206 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:18.188212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:18.188595 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:18.189238 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:18.189253 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.190123 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.190125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:18.191030 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:18.191038 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.191516 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.191518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:18.191668 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.192413 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:18.192429 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:18.194344 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:18.196338 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:18.196348 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:18.196370 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:18.196781 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:18.197156 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:18.197162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:18.197167 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:18.197436 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:18.198080 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:18.198086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:18.198380 (+ 294us) client_negotiation.cc:769] Sending connection context
0811 07:27:18.198557 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 07:27:18.198874 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":128,"threads_started":1}
I20260811 07:27:18.201436 16517 heartbeater.cc:347] Connected to a master server at 127.11.248.62:40271
I20260811 07:27:18.201748 16517 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:18.202471 16517 heartbeater.cc:511] Master 127.11.248.62:40271 requested a full tablet report, sending...
I20260811 07:27:18.204476 16304 ts_manager.cc:194] Registered new tserver with Master: 9e3f95bda8af4704b31bcdfb8d931345 (127.11.248.1:42435)
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:27:18.206136 16304 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:35935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:18.228497 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:40271
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:18.348383 16524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:18.348733 16524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:18.348832 16524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:18.353087 16524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:18.353199 16524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:18.353298 16524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:18.359411 16524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:40271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:18.360675 16524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:18.361814 16524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:18.372131 16534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:18.372131 16531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:18.372539 16524 server_base.cc:1034] running on GCE node
W20260811 07:27:18.372135 16530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:18.373111 16524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:18.373770 16524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:18.374945 16524 hybrid_clock.cc:648] HybridClock initialized: now 1786433238374913 us; error 46 us; skew 500 ppm
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:18.378135 16524 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:18.379179 16524 webserver.cc:460] Webserver started at http://127.11.248.2:45121/ using document root <none> and password file <none>
I20260811 07:27:18.379793 16524 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:18.379861 16524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:18.380097 16524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:18.382391 16524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "ef2bb3122ed4415694a5a594f800135a"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "394db7c634cd62c6e3337947b2b4c449"
server_key_iv: "3c7577d086ecd6485b863785d0dba455"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.383021 16524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "ef2bb3122ed4415694a5a594f800135a"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "394db7c634cd62c6e3337947b2b4c449"
server_key_iv: "3c7577d086ecd6485b863785d0dba455"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.387383 16524 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:18.390192 16542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.391673 16524 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:27:18.391796 16524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "ef2bb3122ed4415694a5a594f800135a"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "394db7c634cd62c6e3337947b2b4c449"
server_key_iv: "3c7577d086ecd6485b863785d0dba455"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.392009 16524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:18.403362 16524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:18.407289 16524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:18.407542 16524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:18.408186 16524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:18.409152 16524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:18.409206 16524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.409250 16524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:18.409264 16524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.418831 16524 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:39631
I20260811 07:27:18.418853 16666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:39631 every 8 connection(s)
I20260811 07:27:18.419787 16524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:18.427045 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16524
I20260811 07:27:18.427182 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:18.427491 12256 external_mini_cluster.cc:1428] Setting key 13679dec1ee748ecc919536d989eee63
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:18.434579 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.421793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:47329 (local address 127.11.248.62:40271)
0811 07:27:18.421961 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:18.421964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:18.422803 (+ 839us) server_negotiation.cc:407] Connection header received
0811 07:27:18.424263 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:18.424267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:18.424330 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:18.424442 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:18.425784 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.426335 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.427595 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.427836 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.427977 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.430805 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:18.430809 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:18.430811 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:18.430837 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:18.432352 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.432940 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.432948 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.432949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.433046 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.433410 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.433413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.433414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.433621 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:18.433733 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:18.434259 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 07:27:18.434403 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:27:18.435459 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.422187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:40271 (local address 127.11.248.2:47329)
0811 07:27:18.422650 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:18.422694 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:18.424039 (+ 1345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:18.424623 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:18.424630 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:18.425112 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:18.425632 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:18.425645 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.426493 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.426502 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:18.427459 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:18.427468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.428036 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.428041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:18.428239 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.428967 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:18.428988 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:18.430622 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:18.432483 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:18.432489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:18.432505 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:18.432780 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:18.433144 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:18.433148 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:18.433150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:18.433303 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:18.433731 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:18.433738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:18.434011 (+ 273us) client_negotiation.cc:769] Sending connection context
0811 07:27:18.434201 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 07:27:18.434558 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":134,"threads_started":1}
I20260811 07:27:18.436781 16667 heartbeater.cc:347] Connected to a master server at 127.11.248.62:40271
I20260811 07:27:18.437093 16667 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:18.437609 16667 heartbeater.cc:511] Master 127.11.248.62:40271 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:18.438721 16304 ts_manager.cc:194] Registered new tserver with Master: ef2bb3122ed4415694a5a594f800135a (127.11.248.2:39631)
I20260811 07:27:18.439456 16304 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:47329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:18.460971 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:40271
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:18.578675 16672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:18.579062 16672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:18.579147 16672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:18.583447 16672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:18.583590 16672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:18.583699 16672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:18.589525 16672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:40271
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:18.590770 16672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:18.591876 16672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:18.602367 16683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:18.602305 16678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:18.602370 16681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:18.602522 16672 server_base.cc:1034] running on GCE node
I20260811 07:27:18.603145 16672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:18.603892 16672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:18.605078 16672 hybrid_clock.cc:648] HybridClock initialized: now 1786433238605047 us; error 54 us; skew 500 ppm
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:18.608086 16672 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:18.609167 16672 webserver.cc:460] Webserver started at http://127.11.248.3:38263/ using document root <none> and password file <none>
I20260811 07:27:18.609822 16672 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:18.609922 16672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:18.610162 16672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:18.612466 16672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "73a67354e4604fe387e62af3bb64bc3a"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "5f356d8bc11054555c0cfd87abe28829"
server_key_iv: "88be45c38d6a7cf5e1631c2dd900a3ee"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.613093 16672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "73a67354e4604fe387e62af3bb64bc3a"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "5f356d8bc11054555c0cfd87abe28829"
server_key_iv: "88be45c38d6a7cf5e1631c2dd900a3ee"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.617079 16672 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:27:18.619786 16691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.621083 16672 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:18.621227 16672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "73a67354e4604fe387e62af3bb64bc3a"
format_stamp: "Formatted at 2026-08-11 07:27:18 on dist-test-slave-77v9"
server_key: "5f356d8bc11054555c0cfd87abe28829"
server_key_iv: "88be45c38d6a7cf5e1631c2dd900a3ee"
server_key_version: "encryptionkey@0"
I20260811 07:27:18.621354 16672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:18.641651 16672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:18.645363 16672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:18.645601 16672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:18.646306 16672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:18.647295 16672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:18.647374 16672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.647452 16672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:18.647505 16672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:18.658430 16672 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:41807
I20260811 07:27:18.658463 16820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:41807 every 8 connection(s)
I20260811 07:27:18.659551 16672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:18.669961 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16672
I20260811 07:27:18.670145 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:18.670572 12256 external_mini_cluster.cc:1428] Setting key 751f47a1eb3a7e7f7626d7ad81c8a203
I20260811 07:27:18.674974 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.661624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:42559 (local address 127.11.248.62:40271)
0811 07:27:18.661783 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:18.661787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:18.662780 (+ 993us) server_negotiation.cc:407] Connection header received
0811 07:27:18.664427 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:18.664431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:18.664500 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:18.664612 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:18.665924 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.666477 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.667629 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.667854 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.667970 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.671180 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:18.671187 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:18.671189 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:18.671217 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:18.672932 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.673476 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.673479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.673480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.673568 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.673967 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.673969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.673970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.674164 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:18.674242 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:18.674728 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 07:27:18.674851 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:27:18.675951 16825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.662087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:40271 (local address 127.11.248.3:42559)
0811 07:27:18.662587 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:18.662635 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:18.664192 (+ 1557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:18.664799 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:18.664854 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:18.665254 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:18.665728 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:18.665755 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.666611 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.666614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:18.667491 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:18.667500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.668017 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.668021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:18.668202 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.668925 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:18.668942 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:18.670961 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:18.673054 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:18.673062 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:18.673079 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:18.673379 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:18.673651 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:18.673654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:18.673655 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:18.673879 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:18.674253 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:18.674258 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:18.674512 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 07:27:18.674678 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 07:27:18.675073 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":139,"threads_started":1}
I20260811 07:27:18.677289 16821 heartbeater.cc:347] Connected to a master server at 127.11.248.62:40271
I20260811 07:27:18.677575 16821 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:18.678126 16821 heartbeater.cc:511] Master 127.11.248.62:40271 requested a full tablet report, sending...
I20260811 07:27:18.679225 16304 ts_manager.cc:194] Registered new tserver with Master: 73a67354e4604fe387e62af3bb64bc3a (127.11.248.3:41807)
I20260811 07:27:18.679783 16304 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:42559
I20260811 07:27:18.685405 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:27:18.716369 16831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.704408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45006 (local address 127.11.248.1:42435)
0811 07:27:18.704784 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:18.704790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:18.704893 (+ 103us) server_negotiation.cc:407] Connection header received
0811 07:27:18.704952 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:18.704958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:18.705174 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:18.705308 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:18.706037 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.706841 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.707792 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.708255 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.708368 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.711830 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:18.711845 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:18.711862 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:18.711898 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:18.714046 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.714604 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.714611 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.714613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.714721 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.715131 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.715135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.715136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.715476 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:18.715668 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:18.715937 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 07:27:18.716173 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":165,"threads_started":1}
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:18.729319 16348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:18.719658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40444 (local address 127.11.248.62:40271)
0811 07:27:18.719844 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:18.719848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:18.719864 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:18.719960 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:18.719963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:18.720009 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:18.720113 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:18.720957 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.721510 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.722335 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:18.722566 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:18.722652 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:18.725710 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:18.725714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:18.725717 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:18.725840 (+ 123us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:18.727435 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.727858 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.727861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.727863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.727957 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:18.728210 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:18.728213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:18.728214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:18.728493 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:18.728612 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:18.728975 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 07:27:18.729122 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 07:27:18.729898 16304 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40444
I20260811 07:27:18.730836 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16372
I20260811 07:27:18.739988 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16524
I20260811 07:27:18.748200 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16672
I20260811 07:27:18.756731 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16265
2026-08-11T07:27:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2384 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16836](info): set up 2 sockets
Aug 11 07:27:18 dist-test-slave-77v9 krb5kdc[16836](info): commencing operation
krb5kdc: starting...
W20260811 07:27:19.904559 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:20.053907 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46111
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:46111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:20.201753 16852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:20.202085 16852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:20.202132 16852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:20.206410 16852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:20.206517 16852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:20.206539 16852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:20.206557 16852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:20.206573 16852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:20.212414 16852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:46111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:20.213713 16852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:20.214751 16852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:20.224063 16859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:20.224095 16862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:20.224066 16858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:20.224408 16852 server_base.cc:1034] running on GCE node
I20260811 07:27:20.225162 16852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:20.226415 16852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:20.227629 16852 hybrid_clock.cc:648] HybridClock initialized: now 1786433240227595 us; error 48 us; skew 500 ppm
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:20.231060 16852 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:20.231978 16852 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:20.232092 16852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:20.232394 16852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:20.235037 16852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "2c6c027155694aac899e2a10202f7a43"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "d3f3d0bd508664d8c02038bfedb33bdc"
server_key_iv: "30fc8bfd7faafae9d0e9f8f57d4c807d"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.235754 16852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "2c6c027155694aac899e2a10202f7a43"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "d3f3d0bd508664d8c02038bfedb33bdc"
server_key_iv: "30fc8bfd7faafae9d0e9f8f57d4c807d"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.240432 16852 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260811 07:27:20.243676 16868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.245419 16852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:20.245617 16852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "2c6c027155694aac899e2a10202f7a43"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "d3f3d0bd508664d8c02038bfedb33bdc"
server_key_iv: "30fc8bfd7faafae9d0e9f8f57d4c807d"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.245770 16852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:20.265873 16852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:20.270828 16852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:20.271098 16852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:20.280376 16852 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:46111
I20260811 07:27:20.280707 16934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:46111 every 8 connection(s)
I20260811 07:27:20.281543 16852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:20.283478 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16852
I20260811 07:27:20.283636 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:20.284014 12256 external_mini_cluster.cc:1428] Setting key f9d9fa977aac4ef2ea0a1295c79911f6
I20260811 07:27:20.285871 16936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:20.294080 16936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43: Bootstrap starting.
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:20.297475 16936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:20.298595 16936 log.cc:824] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:20.301529 16936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43: No bootstrap required, opened a new log
I20260811 07:27:20.302398 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:20.285689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49512 (local address 127.11.248.62:46111)
0811 07:27:20.286227 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:20.286249 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:20.286298 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:27:20.287307 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:20.287333 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:20.287809 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:20.288261 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:20.289209 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.290912 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.291972 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.292762 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.292991 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:20.296087 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:20.296095 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:20.296114 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:20.296157 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:20.298605 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:20.299208 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:20.299214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:20.299220 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:20.299354 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:20.299736 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:20.299740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:20.299741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:20.300388 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:20.300609 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:20.300938 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 07:27:20.301299 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":196,"threads_started":1}
I20260811 07:27:20.306411 16936 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6c027155694aac899e2a10202f7a43" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46111 } }
I20260811 07:27:20.306859 16936 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:20.306965 16936 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c6c027155694aac899e2a10202f7a43, State: Initialized, Role: FOLLOWER
I20260811 07:27:20.307500 16936 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6c027155694aac899e2a10202f7a43" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46111 } }
I20260811 07:27:20.307649 16936 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:20.307705 16936 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:20.307788 16936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:20.308962 16936 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6c027155694aac899e2a10202f7a43" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46111 } }
I20260811 07:27:20.309300 16936 leader_election.cc:302] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c6c027155694aac899e2a10202f7a43; no voters:
I20260811 07:27:20.309679 16936 leader_election.cc:288] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:20.309821 16941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:20.310113 16941 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [term 1 LEADER]: Becoming Leader. State: Replica: 2c6c027155694aac899e2a10202f7a43, State: Running, Role: LEADER
I20260811 07:27:20.310484 16941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6c027155694aac899e2a10202f7a43" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46111 } }
I20260811 07:27:20.311192 16936 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:20.312515 16943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c6c027155694aac899e2a10202f7a43. Latest consensus state: current_term: 1 leader_uuid: "2c6c027155694aac899e2a10202f7a43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6c027155694aac899e2a10202f7a43" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46111 } } }
I20260811 07:27:20.312683 16943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:20.313036 16942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c6c027155694aac899e2a10202f7a43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c6c027155694aac899e2a10202f7a43" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46111 } } }
I20260811 07:27:20.313155 16942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:20.313107 16950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:20.316525 16950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:20.322553 16950 catalog_manager.cc:1347] Generated new cluster ID: 57d017769dac4a489d9d8d4435989faf
I20260811 07:27:20.322660 16950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:20.336992 16950 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:20.338608 16950 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:20.345238 16950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43: Generated new TSK 0
I20260811 07:27:20.346277 16950 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:20.388597 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46111
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:20.509908 16963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:20.510283 16963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:20.510367 16963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:20.514899 16963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:20.515025 16963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:20.515131 16963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:20.520928 16963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:20.522218 16963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:20.523339 16963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:20.533859 16974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:20.533849 16973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:20.534124 16976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:20.534253 16963 server_base.cc:1034] running on GCE node
I20260811 07:27:20.534734 16963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:20.535463 16963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:20.536671 16963 hybrid_clock.cc:648] HybridClock initialized: now 1786433240536654 us; error 35 us; skew 500 ppm
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:20.546903 16963 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:20.548007 16963 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:20.548141 16963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:20.548451 16963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:20.551131 16963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "6345207f64974273b88eda672154fbad"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "8d36435a234399be28e07057c3b98aab"
server_key_iv: "59789abf21fdaa4a649c31082236d1cf"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.551836 16963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "6345207f64974273b88eda672154fbad"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "8d36435a234399be28e07057c3b98aab"
server_key_iv: "59789abf21fdaa4a649c31082236d1cf"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.556038 16963 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:27:20.559069 16983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.560559 16963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:27:20.560712 16963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "6345207f64974273b88eda672154fbad"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "8d36435a234399be28e07057c3b98aab"
server_key_iv: "59789abf21fdaa4a649c31082236d1cf"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.560897 16963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:20.585515 16963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:20.589329 16963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:20.589511 16963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:20.590106 16963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:20.591081 16963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:20.591136 16963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.591182 16963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:20.591248 16963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.601393 16963 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:45687
I20260811 07:27:20.601490 17116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:45687 every 8 connection(s)
I20260811 07:27:20.602133 16963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:20.608109 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 16963
I20260811 07:27:20.608227 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:20.608532 12256 external_mini_cluster.cc:1428] Setting key a71c69700969b39402ca5a7de993a081
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:20.618319 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:20.604704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:55797 (local address 127.11.248.62:46111)
0811 07:27:20.604894 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:20.604900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:20.605935 (+ 1035us) server_negotiation.cc:407] Connection header received
0811 07:27:20.607273 (+ 1338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:20.607276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:20.607327 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:20.607445 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:20.608944 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.609509 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.610701 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.611076 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.611188 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:20.614393 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:20.614397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:20.614399 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:20.614425 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:20.616052 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:20.616621 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:20.616624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:20.616625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:20.616702 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:20.617108 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:20.617111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:20.617113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:20.617330 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:20.617437 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:20.617969 (+ 532us) server_negotiation.cc:299] Negotiation successful
0811 07:27:20.618117 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:27:20.619184 17119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:20.605188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:46111 (local address 127.11.248.1:55797)
0811 07:27:20.605696 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:20.605746 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:20.607041 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:20.607659 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:20.607666 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:20.608096 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:20.608732 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:20.608748 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.609645 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.609648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:20.610554 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:20.610564 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.611244 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.611249 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:20.611442 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:20.612126 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:20.612153 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:20.614167 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:20.616182 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:20.616188 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:20.616204 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:20.616499 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:20.616831 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:20.616838 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:20.616842 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:20.616997 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:20.617436 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:20.617443 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:20.617709 (+ 266us) client_negotiation.cc:769] Sending connection context
0811 07:27:20.617908 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 07:27:20.618267 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":133,"threads_started":1}
I20260811 07:27:20.620666 17117 heartbeater.cc:347] Connected to a master server at 127.11.248.62:46111
I20260811 07:27:20.620975 17117 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:20.621485 17117 heartbeater.cc:511] Master 127.11.248.62:46111 requested a full tablet report, sending...
I20260811 07:27:20.623101 16892 ts_manager.cc:194] Registered new tserver with Master: 6345207f64974273b88eda672154fbad (127.11.248.1:45687)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:27:20.624430 16892 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:55797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:20.644145 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46111
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:20.762172 17122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:20.762467 17122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:20.762514 17122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:20.766710 17122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:20.766791 17122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:20.766865 17122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:20.772776 17122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:20.774075 17122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:20.775144 17122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:20.785204 17130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:20.785204 17128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:20.785353 17122 server_base.cc:1034] running on GCE node
W20260811 07:27:20.785526 17127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:20.786000 17122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:20.786720 17122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:20.787953 17122 hybrid_clock.cc:648] HybridClock initialized: now 1786433240787917 us; error 49 us; skew 500 ppm
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:20.791450 17122 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:20.792455 17122 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:20.792577 17122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:20.792943 17122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:20.795463 17122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "fe56be62c44f4413b60558e60e00c6ac"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "60d56476de81ee8e29a33cca0845c7d5"
server_key_iv: "d5174d00cda7620333faf089ccaeca8d"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.796221 17122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "fe56be62c44f4413b60558e60e00c6ac"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "60d56476de81ee8e29a33cca0845c7d5"
server_key_iv: "d5174d00cda7620333faf089ccaeca8d"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.801002 17122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.005s
I20260811 07:27:20.803755 17137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.805616 17122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:20.805809 17122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "fe56be62c44f4413b60558e60e00c6ac"
format_stamp: "Formatted at 2026-08-11 07:27:20 on dist-test-slave-77v9"
server_key: "60d56476de81ee8e29a33cca0845c7d5"
server_key_iv: "d5174d00cda7620333faf089ccaeca8d"
server_key_version: "encryptionkey@0"
I20260811 07:27:20.805963 17122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:20.819247 17122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:20.822739 17122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:20.822993 17122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:20.823632 17122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:20.824538 17122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:20.824625 17122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.824721 17122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:20.824769 17122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:20.834625 17122 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:44529
I20260811 07:27:20.834641 17262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:44529 every 8 connection(s)
I20260811 07:27:20.835297 17122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:20.842581 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 17122
I20260811 07:27:20.842708 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:20.843086 12256 external_mini_cluster.cc:1428] Setting key 4aff4e5cf4abc4a4038916e0226fedff
Aug 11 07:27:20 dist-test-slave-77v9 krb5kdc[16836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:20.852485 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:20.837276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:39509 (local address 127.11.248.62:46111)
0811 07:27:20.837444 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:20.837448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:20.838407 (+ 959us) server_negotiation.cc:407] Connection header received
0811 07:27:20.839987 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:20.839991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:20.840064 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:20.840184 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:20.841685 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.842350 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.843931 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.844201 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.844332 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:20.847784 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:20.847792 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:20.847796 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:20.847842 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:20.849893 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:20.850593 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:20.850599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:20.850601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:20.850715 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:20.851149 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:20.851154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:20.851155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:20.851415 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:20.851558 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:20.852141 (+ 583us) server_negotiation.cc:299] Negotiation successful
0811 07:27:20.852297 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:27:20.853631 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:20.837626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:46111 (local address 127.11.248.2:39509)
0811 07:27:20.838213 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:20.838266 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:20.839693 (+ 1427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:20.840388 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:20.840396 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:20.840928 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:20.841492 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:20.841508 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.842529 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.842532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:20.843789 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:20.843801 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:20.844381 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:20.844385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:20.844618 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:20.845401 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:20.845419 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:20.847538 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:20.850061 (+ 2523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:20.850069 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:20.850096 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:20.850452 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:20.850836 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:20.850841 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:20.850843 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:20.851019 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:20.851542 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:20.851550 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:20.851860 (+ 310us) client_negotiation.cc:769] Sending connection context
0811 07:27:20.852088 (+ 228us) client_negotiation.cc:240] Negotiation successful
0811 07:27:20.852503 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":123,"threads_started":1}
I20260811 07:27:20.855189 17263 heartbeater.cc:347] Connected to a master server at 127.11.248.62:46111
I20260811 07:27:20.855490 17263 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:20.856055 17263 heartbeater.cc:511] Master 127.11.248.62:46111 requested a full tablet report, sending...
I20260811 07:27:20.857389 16892 ts_manager.cc:194] Registered new tserver with Master: fe56be62c44f4413b60558e60e00c6ac (127.11.248.2:44529)
I20260811 07:27:20.858094 16892 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:39509
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:20.880968 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46111
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:21.001650 17268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:21.001977 17268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:21.002029 17268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:21.006373 17268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:21.006488 17268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:21.006599 17268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:21.012938 17268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:46111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:21.014183 17268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:21.015304 17268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:21.025511 17280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:21.025517 17274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:21.025575 17273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:21.025986 17268 server_base.cc:1034] running on GCE node
I20260811 07:27:21.026423 17268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:21.027132 17268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:21.028352 17268 hybrid_clock.cc:648] HybridClock initialized: now 1786433241028328 us; error 37 us; skew 500 ppm
Aug 11 07:27:21 dist-test-slave-77v9 krb5kdc[16836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433241, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:21.031741 17268 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:21.032624 17268 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:21.032728 17268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:21.033006 17268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:21.035221 17268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "07d856ba2af340d1946c35c526d008d3"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "5a1eab33875c20af12ce4c1ded57aab3"
server_key_iv: "85d91cb20c8d62cddc51404858f76cb3"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.035852 17268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "07d856ba2af340d1946c35c526d008d3"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "5a1eab33875c20af12ce4c1ded57aab3"
server_key_iv: "85d91cb20c8d62cddc51404858f76cb3"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.040074 17268 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 07:27:21.043044 17288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.044597 17268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:21.044761 17268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "07d856ba2af340d1946c35c526d008d3"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "5a1eab33875c20af12ce4c1ded57aab3"
server_key_iv: "85d91cb20c8d62cddc51404858f76cb3"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.044955 17268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:21.070223 17268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:21.073637 17268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:21.073877 17268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:21.074544 17268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:21.075490 17268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:21.075565 17268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.075630 17268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:21.075675 17268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.085568 17268 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:34621
I20260811 07:27:21.085638 17414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:34621 every 8 connection(s)
I20260811 07:27:21.086288 17268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:21.089915 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 17268
I20260811 07:27:21.090078 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:21.090378 12256 external_mini_cluster.cc:1428] Setting key 70348119ad760a8538e46637c77d8099
Aug 11 07:27:21 dist-test-slave-77v9 krb5kdc[16836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433241, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:21.101205 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.088170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:60157 (local address 127.11.248.62:46111)
0811 07:27:21.088329 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.088333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.089206 (+ 873us) server_negotiation.cc:407] Connection header received
0811 07:27:21.090688 (+ 1482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.090691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.090756 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.090854 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:21.092084 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.092737 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.093959 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.094192 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.094303 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.096976 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:21.096979 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:21.096981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:21.097009 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:21.098683 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:21.099350 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:21.099357 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:21.099358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:21.099465 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:21.099935 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:21.099938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:21.099939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:21.100146 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:21.100263 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.100872 (+ 609us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.101022 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:27:21.102211 17417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.088485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:46111 (local address 127.11.248.3:60157)
0811 07:27:21.089035 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.089080 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.090433 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.091047 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.091054 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.091436 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:21.091933 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.091946 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.092913 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.092917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.093828 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.093837 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.094364 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.094369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.094548 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.095125 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:21.095147 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:21.096726 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:21.098889 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:21.098897 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:21.098916 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:21.099225 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:21.099568 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:21.099574 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:21.099577 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:21.099743 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:21.100263 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:21.100272 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:21.100569 (+ 297us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.100850 (+ 281us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.101230 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":133,"threads_started":1}
I20260811 07:27:21.103646 17415 heartbeater.cc:347] Connected to a master server at 127.11.248.62:46111
I20260811 07:27:21.104027 17415 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:21.104679 17415 heartbeater.cc:511] Master 127.11.248.62:46111 requested a full tablet report, sending...
I20260811 07:27:21.105744 16892 ts_manager.cc:194] Registered new tserver with Master: 07d856ba2af340d1946c35c526d008d3 (127.11.248.3:34621)
I20260811 07:27:21.106362 16892 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:60157
I20260811 07:27:21.117147 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:27:21.127920 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.119419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49514 (local address 127.11.248.62:46111)
0811 07:27:21.119618 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.119622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.119699 (+ 77us) server_negotiation.cc:407] Connection header received
0811 07:27:21.119888 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.119890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.119996 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.120091 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:21.120961 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.121496 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.122470 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.122680 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.122757 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.124274 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:21.124278 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:21.124280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:21.124304 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:21.125865 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:21.126375 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:21.126378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:21.126379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:21.126475 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:21.126884 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:21.126887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:21.126888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:21.127137 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:21.127252 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.127513 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.127630 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 07:27:21.131349 16892 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49514:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:21.134629 16892 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:21.152328 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.144757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:44529 (local address 127.0.0.1:52932)
0811 07:27:21.145530 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.145593 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.145738 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.146717 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.146724 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.146782 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:21.147220 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.147228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.149009 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.149012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.150411 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.150422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.151558 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.151562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.151741 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.151871 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.151995 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.152148 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"mutex_wait_us":393,"spinlock_wait_cycles":2176,"thread_start_us":178,"threads_started":1}
I20260811 07:27:21.152333 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.145948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45298 (local address 127.11.248.3:34621)
0811 07:27:21.146770 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.146784 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.146815 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:27:21.146885 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.146889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.147080 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.147228 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:21.147461 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.148576 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.150561 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.151414 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.151536 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.151696 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.152030 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.152143 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":164,"threads_started":1}
I20260811 07:27:21.152395 17429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.144589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45687 (local address 127.0.0.1:40422)
0811 07:27:21.145531 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.145594 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.145749 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.146834 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.146837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.146852 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:21.147029 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.147038 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.149161 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.149165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.150733 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.150749 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.151874 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.151878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.151985 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.152008 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.152054 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.152143 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"spinlock_wait_cycles":7296,"thread_start_us":124,"threads_started":1}
I20260811 07:27:21.153046 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.145502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40422 (local address 127.11.248.1:45687)
0811 07:27:21.146158 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.146165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.146190 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:27:21.146343 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.146348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.146678 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.146837 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:21.147146 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.148544 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.150917 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.151719 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.152522 (+ 803us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.152678 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.152735 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.152886 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":108,"threads_started":1}
I20260811 07:27:21.153288 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.145504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:34621 (local address 127.0.0.1:45298)
0811 07:27:21.146380 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.146395 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.146504 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.147214 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.147217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.147246 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:21.147345 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.147351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.148756 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.148760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.150433 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.150439 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.151548 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.151553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.151797 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.151880 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.151984 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.153145 (+ 1161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":87,"thread_start_us":89,"threads_started":1}
I20260811 07:27:21.153931 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.144959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52932 (local address 127.11.248.2:44529)
0811 07:27:21.146086 (+ 1127us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.146103 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.146131 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:27:21.146213 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.146218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.146477 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.146966 (+ 489us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:21.147357 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.148847 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.150561 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.151414 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.151779 (+ 365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.151923 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.152591 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.152693 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1010,"thread_start_us":142,"threads_started":1}
I20260811 07:27:21.156854 17190 tablet_service.cc:1467] Processing CreateTablet for tablet 2c40262a19964caaa8d0dcafcb5ddca4 (DEFAULT_TABLE table=test-table [id=aad23f00cf764a6d893adf31d9eb9903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:21.158221 17190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c40262a19964caaa8d0dcafcb5ddca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:21.159066 17038 tablet_service.cc:1467] Processing CreateTablet for tablet 2c40262a19964caaa8d0dcafcb5ddca4 (DEFAULT_TABLE table=test-table [id=aad23f00cf764a6d893adf31d9eb9903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:21.160245 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c40262a19964caaa8d0dcafcb5ddca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:21.156795 17341 tablet_service.cc:1467] Processing CreateTablet for tablet 2c40262a19964caaa8d0dcafcb5ddca4 (DEFAULT_TABLE table=test-table [id=aad23f00cf764a6d893adf31d9eb9903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:21.162134 17341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c40262a19964caaa8d0dcafcb5ddca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:21.168573 17436 tablet_bootstrap.cc:492] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Bootstrap starting.
I20260811 07:27:21.169006 17435 tablet_bootstrap.cc:492] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Bootstrap starting.
I20260811 07:27:21.169167 17437 tablet_bootstrap.cc:492] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: Bootstrap starting.
I20260811 07:27:21.171370 17437 tablet_bootstrap.cc:654] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:21.171408 17436 tablet_bootstrap.cc:654] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:21.171408 17435 tablet_bootstrap.cc:654] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:21.172209 17437 log.cc:824] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:21.172904 17435 log.cc:824] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:21.172905 17436 log.cc:824] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:21.174481 17437 tablet_bootstrap.cc:492] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: No bootstrap required, opened a new log
I20260811 07:27:21.174721 17437 ts_tablet_manager.cc:1397] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:27:21.174837 17435 tablet_bootstrap.cc:492] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: No bootstrap required, opened a new log
I20260811 07:27:21.175024 17435 ts_tablet_manager.cc:1397] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:27:21.176422 17436 tablet_bootstrap.cc:492] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: No bootstrap required, opened a new log
I20260811 07:27:21.176622 17436 ts_tablet_manager.cc:1397] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 07:27:21.179227 17437 raft_consensus.cc:348] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.179522 17437 raft_consensus.cc:374] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:21.179345 17435 raft_consensus.cc:348] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.179590 17437 raft_consensus.cc:729] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6345207f64974273b88eda672154fbad, State: Initialized, Role: FOLLOWER
I20260811 07:27:21.179648 17435 raft_consensus.cc:374] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:21.179745 17435 raft_consensus.cc:729] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56be62c44f4413b60558e60e00c6ac, State: Initialized, Role: FOLLOWER
I20260811 07:27:21.180115 17437 consensus_queue.cc:260] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.180276 17435 consensus_queue.cc:260] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.181080 17263 heartbeater.cc:503] Master 127.11.248.62:46111 was elected leader, sending a full tablet report...
I20260811 07:27:21.181326 17437 ts_tablet_manager.cc:1428] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:27:21.181368 17435 ts_tablet_manager.cc:1428] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:27:21.181716 17117 heartbeater.cc:503] Master 127.11.248.62:46111 was elected leader, sending a full tablet report...
I20260811 07:27:21.181682 17436 raft_consensus.cc:348] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.181998 17436 raft_consensus.cc:374] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:21.182077 17436 raft_consensus.cc:729] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d856ba2af340d1946c35c526d008d3, State: Initialized, Role: FOLLOWER
I20260811 07:27:21.182525 17436 consensus_queue.cc:260] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.183596 17415 heartbeater.cc:503] Master 127.11.248.62:46111 was elected leader, sending a full tablet report...
I20260811 07:27:21.183666 17436 ts_tablet_manager.cc:1428] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 07:27:21.308907 17443 raft_consensus.cc:482] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:21.309186 17443 raft_consensus.cc:504] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.310803 17443 leader_election.cc:288] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6345207f64974273b88eda672154fbad (127.11.248.1:45687), 07d856ba2af340d1946c35c526d008d3 (127.11.248.3:34621)
I20260811 07:27:21.315397 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.311023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45687 (local address 127.11.248.2:51603)
0811 07:27:21.311158 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.311177 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.311283 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.311655 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.311659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.311679 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:21.311853 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.311863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.312878 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.312885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.313991 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.314003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.314892 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.314896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.315018 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.315046 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.315143 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.315231 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":22}
I20260811 07:27:21.315475 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.311181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:51603 (local address 127.11.248.1:45687)
0811 07:27:21.311330 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.311335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.311354 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:27:21.311417 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.311420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.311469 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.311604 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:21.311979 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.312712 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.314145 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.314706 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.314811 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.314855 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.315233 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.315334 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:27:21.315761 17434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.311498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48795 (local address 127.11.248.3:34621)
0811 07:27:21.311659 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.311664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.311794 (+ 130us) server_negotiation.cc:407] Connection header received
0811 07:27:21.311939 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.311941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.311994 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.312079 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:21.312459 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.313145 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.314546 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.315120 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.315234 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.315289 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.315562 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.315650 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:27:21.316126 17445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.311334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:34621 (local address 127.11.248.2:48795)
0811 07:27:21.311713 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.311727 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.311811 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.312151 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.312158 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.312184 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:21.312322 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.312328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.313269 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.313273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.314396 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:21.314407 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.315267 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.315271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:21.315388 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.315412 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.315950 (+ 538us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.316023 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":2,"thread_start_us":102,"threads_started":1}
I20260811 07:27:21.316181 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c40262a19964caaa8d0dcafcb5ddca4" candidate_uuid: "fe56be62c44f4413b60558e60e00c6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6345207f64974273b88eda672154fbad" is_pre_election: true
I20260811 07:27:21.316552 17060 raft_consensus.cc:2454] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56be62c44f4413b60558e60e00c6ac in term 0.
I20260811 07:27:21.317137 17139 leader_election.cc:302] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6345207f64974273b88eda672154fbad, fe56be62c44f4413b60558e60e00c6ac; no voters:
I20260811 07:27:21.317485 17443 raft_consensus.cc:2781] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:21.317449 17363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c40262a19964caaa8d0dcafcb5ddca4" candidate_uuid: "fe56be62c44f4413b60558e60e00c6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d856ba2af340d1946c35c526d008d3" is_pre_election: true
I20260811 07:27:21.317588 17443 raft_consensus.cc:482] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:21.317638 17443 raft_consensus.cc:3037] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:21.317771 17363 raft_consensus.cc:2454] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56be62c44f4413b60558e60e00c6ac in term 0.
I20260811 07:27:21.319002 17443 raft_consensus.cc:504] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.319296 17443 leader_election.cc:288] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [CANDIDATE]: Term 1 election: Requested vote from peers 6345207f64974273b88eda672154fbad (127.11.248.1:45687), 07d856ba2af340d1946c35c526d008d3 (127.11.248.3:34621)
I20260811 07:27:21.319694 17060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c40262a19964caaa8d0dcafcb5ddca4" candidate_uuid: "fe56be62c44f4413b60558e60e00c6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6345207f64974273b88eda672154fbad"
I20260811 07:27:21.319725 17363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c40262a19964caaa8d0dcafcb5ddca4" candidate_uuid: "fe56be62c44f4413b60558e60e00c6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d856ba2af340d1946c35c526d008d3"
I20260811 07:27:21.319846 17060 raft_consensus.cc:3037] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:21.319880 17363 raft_consensus.cc:3037] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:21.320991 17060 raft_consensus.cc:2454] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56be62c44f4413b60558e60e00c6ac in term 1.
I20260811 07:27:21.321060 17363 raft_consensus.cc:2454] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56be62c44f4413b60558e60e00c6ac in term 1.
I20260811 07:27:21.321395 17139 leader_election.cc:302] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6345207f64974273b88eda672154fbad, fe56be62c44f4413b60558e60e00c6ac; no voters:
I20260811 07:27:21.321606 17443 raft_consensus.cc:2781] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:21.321871 17443 raft_consensus.cc:686] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 1 LEADER]: Becoming Leader. State: Replica: fe56be62c44f4413b60558e60e00c6ac, State: Running, Role: LEADER
I20260811 07:27:21.322227 17443 consensus_queue.cc:237] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } }
I20260811 07:27:21.325572 16890 catalog_manager.cc:5495] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac reported cstate change: term changed from 0 to 1, leader changed from <none> to fe56be62c44f4413b60558e60e00c6ac (127.11.248.2). New cstate: current_term: 1 leader_uuid: "fe56be62c44f4413b60558e60e00c6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56be62c44f4413b60558e60e00c6ac" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 } health_report { overall_health: UNKNOWN } } }
W20260811 07:27:21.336436 17264 tablet.cc:2369] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:27:21.337256 17416 tablet.cc:2369] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:21.345661 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.341808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52942 (local address 127.11.248.2:44529)
0811 07:27:21.341984 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.341989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.342004 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:21.342195 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.342197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.342254 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.342376 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:21.342651 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.343173 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.344046 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:21.344274 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:21.344396 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:21.344716 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:21.345227 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:21.345365 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.345429 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.345490 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:27:21.352314 17363 raft_consensus.cc:1261] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 1 FOLLOWER]: Refusing update from remote peer fe56be62c44f4413b60558e60e00c6ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:21.352341 17060 raft_consensus.cc:1261] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad [term 1 FOLLOWER]: Refusing update from remote peer fe56be62c44f4413b60558e60e00c6ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:21.353193 17443 consensus_queue.cc:1035] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d856ba2af340d1946c35c526d008d3" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 34621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:21.353478 17446 consensus_queue.cc:1035] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6345207f64974273b88eda672154fbad" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:27:21.353632 17118 tablet.cc:2369] T 2c40262a19964caaa8d0dcafcb5ddca4 P 6345207f64974273b88eda672154fbad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:21.362432 17450 mvcc.cc:205] Tried to move back new op lower bound from 7317230556570947584 to 7317230556458938368. Current Snapshot: MvccSnapshot[applied={T|T < 7317230556570947584}]
I20260811 07:27:21.365610 17451 mvcc.cc:205] Tried to move back new op lower bound from 7317230556570947584 to 7317230556458938368. Current Snapshot: MvccSnapshot[applied={T|T < 7317230556570947584}]
I20260811 07:27:21.372162 16890 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:21.372387 16890 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49514:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:21.375181 16890 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c6c027155694aac899e2a10202f7a43: Sending DeleteTablet for 3 replicas of tablet 2c40262a19964caaa8d0dcafcb5ddca4
I20260811 07:27:21.376245 17038 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c40262a19964caaa8d0dcafcb5ddca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:21 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:40422
I20260811 07:27:21.376245 17341 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c40262a19964caaa8d0dcafcb5ddca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:21 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:45298
I20260811 07:27:21.376478 17190 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c40262a19964caaa8d0dcafcb5ddca4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:21 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:52932
I20260811 07:27:21.376998 17461 tablet_replica.cc:330] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: stopping tablet replica
I20260811 07:27:21.376986 17460 tablet_replica.cc:330] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: stopping tablet replica
I20260811 07:27:21.377374 17461 raft_consensus.cc:2229] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:21.377374 17460 raft_consensus.cc:2229] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:21.377542 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16963
I20260811 07:27:21.377839 17461 raft_consensus.cc:2258] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:21.377866 17460 raft_consensus.cc:2258] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:21.379504 17460 ts_tablet_manager.cc:1905] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:21.382455 17461 ts_tablet_manager.cc:1905] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:21.382506 17460 ts_tablet_manager.cc:1918] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:21.382607 17460 log.cc:1196] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/2c40262a19964caaa8d0dcafcb5ddca4
I20260811 07:27:21.382979 17460 ts_tablet_manager.cc:1939] T 2c40262a19964caaa8d0dcafcb5ddca4 P 07d856ba2af340d1946c35c526d008d3: Deleting consensus metadata
I20260811 07:27:21.384493 16870 catalog_manager.cc:4841] TS 07d856ba2af340d1946c35c526d008d3 (127.11.248.3:34621): tablet 2c40262a19964caaa8d0dcafcb5ddca4 (table test-table [id=aad23f00cf764a6d893adf31d9eb9903]) successfully deleted
I20260811 07:27:21.385550 17461 ts_tablet_manager.cc:1918] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:21.385686 17461 log.cc:1196] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/2c40262a19964caaa8d0dcafcb5ddca4
I20260811 07:27:21.386044 17461 ts_tablet_manager.cc:1939] T 2c40262a19964caaa8d0dcafcb5ddca4 P fe56be62c44f4413b60558e60e00c6ac: Deleting consensus metadata
I20260811 07:27:21.387176 16871 catalog_manager.cc:4841] TS fe56be62c44f4413b60558e60e00c6ac (127.11.248.2:44529): tablet 2c40262a19964caaa8d0dcafcb5ddca4 (table test-table [id=aad23f00cf764a6d893adf31d9eb9903]) successfully deleted
W20260811 07:27:21.392066 16870 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:45687 (error 108)
I20260811 07:27:21.392815 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 17122
I20260811 07:27:21.396051 17428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.393143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45687 (local address 127.0.0.1:40432)
0811 07:27:21.395780 (+ 2637us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.395907 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:45687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2495}
W20260811 07:27:21.396638 16870 catalog_manager.cc:4584] TS 6345207f64974273b88eda672154fbad (127.11.248.1:45687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c40262a19964caaa8d0dcafcb5ddca4: Network error: Client connection negotiation failed: client connection to 127.11.248.1:45687: connect: Connection refused (error 111)
I20260811 07:27:21.406327 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 17268
I20260811 07:27:21.415352 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 16852
2026-08-11T07:27:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2660 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T07:27:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:21Z Disabled control of system clock
I20260811 07:27:21.455060 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43283
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:43289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:43283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:27:21.569905 17467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:21.570261 17467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:21.570375 17467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:21.574744 17467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:21.574864 17467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:21.574895 17467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:21.574934 17467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:21.574994 17467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:21.580047 17467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:43283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:21.581378 17467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:21.582844 17467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:21.591820 17473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:21.591836 17476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:21.591935 17474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:21.592276 17467 server_base.cc:1034] running on GCE node
I20260811 07:27:21.593055 17467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:21.594300 17467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:21.595482 17467 hybrid_clock.cc:648] HybridClock initialized: now 1786433241595460 us; error 35 us; skew 500 ppm
I20260811 07:27:21.597831 17467 webserver.cc:460] Webserver started at http://127.11.248.62:33351/ using document root <none> and password file <none>
I20260811 07:27:21.598460 17467 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:21.598533 17467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:21.598758 17467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:21.601022 17467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "76f928c8506c461b9bdb6271eceba813"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "5b7d46c063b11a6c076678788e3cba7d"
server_key_iv: "1fcc8c7bfbbbe37597450b6d01a5ff9d"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.601752 17467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "76f928c8506c461b9bdb6271eceba813"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "5b7d46c063b11a6c076678788e3cba7d"
server_key_iv: "1fcc8c7bfbbbe37597450b6d01a5ff9d"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.605844 17467 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:27:21.608577 17482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.610046 17467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:27:21.610200 17467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "76f928c8506c461b9bdb6271eceba813"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "5b7d46c063b11a6c076678788e3cba7d"
server_key_iv: "1fcc8c7bfbbbe37597450b6d01a5ff9d"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.610332 17467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:21.615314 17467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:21.616034 17467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:21.616233 17467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:21.623728 17467 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:43283
I20260811 07:27:21.623736 17541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:43283 every 8 connection(s)
I20260811 07:27:21.624774 17467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:21.628688 17543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:21.631855 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 17467
I20260811 07:27:21.632046 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:21.632335 12256 external_mini_cluster.cc:1428] Setting key 71576cea499b30462d4c5252a4169057
I20260811 07:27:21.635460 17543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813: Bootstrap starting.
I20260811 07:27:21.638439 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.633951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49390 (local address 127.11.248.62:43283)
0811 07:27:21.634603 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.634618 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.634654 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:27:21.635293 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.635310 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.635731 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.636028 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:21.637044 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:21.637049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:21.637062 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:21.637073 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:21.637137 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:21.637154 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:21.637272 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.637417 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.637718 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":155,"threads_started":1}
I20260811 07:27:21.638528 17543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:21.639410 17543 log.cc:824] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:21.641779 17543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813: No bootstrap required, opened a new log
I20260811 07:27:21.646080 17543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76f928c8506c461b9bdb6271eceba813" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43283 } }
I20260811 07:27:21.646359 17543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:21.646409 17543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f928c8506c461b9bdb6271eceba813, State: Initialized, Role: FOLLOWER
I20260811 07:27:21.646901 17543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76f928c8506c461b9bdb6271eceba813" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43283 } }
I20260811 07:27:21.647042 17543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:21.647096 17543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:21.647177 17543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:21.648254 17543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76f928c8506c461b9bdb6271eceba813" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43283 } }
I20260811 07:27:21.648607 17543 leader_election.cc:302] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76f928c8506c461b9bdb6271eceba813; no voters:
I20260811 07:27:21.648995 17543 leader_election.cc:288] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:21.649134 17548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:21.649395 17548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [term 1 LEADER]: Becoming Leader. State: Replica: 76f928c8506c461b9bdb6271eceba813, State: Running, Role: LEADER
I20260811 07:27:21.649736 17548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76f928c8506c461b9bdb6271eceba813" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43283 } }
I20260811 07:27:21.650517 17543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:21.651574 17550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76f928c8506c461b9bdb6271eceba813. Latest consensus state: current_term: 1 leader_uuid: "76f928c8506c461b9bdb6271eceba813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76f928c8506c461b9bdb6271eceba813" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43283 } } }
I20260811 07:27:21.651741 17550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:21.651592 17549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76f928c8506c461b9bdb6271eceba813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76f928c8506c461b9bdb6271eceba813" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43283 } } }
I20260811 07:27:21.651942 17549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:21.652196 17557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:21.655704 17557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:21.661984 17557 catalog_manager.cc:1347] Generated new cluster ID: 53459800817d4fd28fb63c9c76951dba
I20260811 07:27:21.662081 17557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:21.673710 17557 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:21.674095 17557 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:21.678803 17557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813: Generated new TSK 0
I20260811 07:27:21.679566 17557 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:21.688791 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43283
--builtin_ntp_servers=127.11.248.20:43289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:27:21.803395 17568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:21.803682 17568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:21.803725 17568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:21.807991 17568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:21.808074 17568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:21.808137 17568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:21.813202 17568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:21.814512 17568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:21.816095 17568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:21.826818 17574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:21.826818 17577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:21.826846 17573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:21.827165 17568 server_base.cc:1034] running on GCE node
I20260811 07:27:21.827759 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:21.828540 17568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:21.829710 17568 hybrid_clock.cc:648] HybridClock initialized: now 1786433241829675 us; error 50 us; skew 500 ppm
I20260811 07:27:21.831815 17568 webserver.cc:460] Webserver started at http://127.11.248.1:35303/ using document root <none> and password file <none>
I20260811 07:27:21.832454 17568 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:21.832526 17568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:21.832752 17568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:21.834986 17568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "b914b977906b4462b99536697e2dc3a5"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "a70bf5660f576e4541cbf1f7c2d14d53"
server_key_iv: "505426e39d9e35da3a313a5a5eae3875"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.835593 17568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "b914b977906b4462b99536697e2dc3a5"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "a70bf5660f576e4541cbf1f7c2d14d53"
server_key_iv: "505426e39d9e35da3a313a5a5eae3875"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.839561 17568 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:21.842399 17583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.843713 17568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:27:21.843858 17568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "b914b977906b4462b99536697e2dc3a5"
format_stamp: "Formatted at 2026-08-11 07:27:21 on dist-test-slave-77v9"
server_key: "a70bf5660f576e4541cbf1f7c2d14d53"
server_key_iv: "505426e39d9e35da3a313a5a5eae3875"
server_key_version: "encryptionkey@0"
I20260811 07:27:21.843995 17568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:21.848963 17568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:21.849633 17568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:21.849838 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:21.850486 17568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:21.851567 17568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:21.851636 17568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.851706 17568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:21.851756 17568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:21.861580 17568 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:38647
I20260811 07:27:21.861604 17709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:38647 every 8 connection(s)
I20260811 07:27:21.862599 17568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:21.866503 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 17568
I20260811 07:27:21.866650 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:21.866940 12256 external_mini_cluster.cc:1428] Setting key 8d21df4c257d446f6be1dbdde8fb6779
I20260811 07:27:21.869326 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43283
--builtin_ntp_servers=127.11.248.20:43289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 07:27:21.870014 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.864680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:56775 (local address 127.11.248.62:43283)
0811 07:27:21.864866 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:21.864871 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:21.866048 (+ 1177us) server_negotiation.cc:407] Connection header received
0811 07:27:21.867871 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:21.867874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:21.867911 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:21.868029 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:21.869460 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:21.869467 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:21.869471 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:21.869489 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:21.869519 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:21.869532 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:21.869650 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:21.869812 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 07:27:21.869860 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:21.870924 17712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:21.865103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43283 (local address 127.11.248.1:56775)
0811 07:27:21.865871 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:21.865928 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:21.867638 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:21.868237 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:21.868247 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:21.868361 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:21.869102 (+ 741us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:21.869106 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:21.869164 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:21.869255 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:21.869651 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:21.869663 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:21.869673 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:27:21.869864 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 07:27:21.870120 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":118,"threads_started":1}
I20260811 07:27:21.872354 17710 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43283
I20260811 07:27:21.872640 17710 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:21.873224 17710 heartbeater.cc:511] Master 127.11.248.62:43283 requested a full tablet report, sending...
I20260811 07:27:21.875186 17500 ts_manager.cc:194] Registered new tserver with Master: b914b977906b4462b99536697e2dc3a5 (127.11.248.1:38647)
W20260811 07:27:21.987864 17713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:21.988178 17713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:21.988277 17713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:21.992901 17713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:21.993003 17713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:21.993069 17713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:21.998286 17713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:21.999459 17713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:22.000998 17713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:22.012044 17720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:22.012044 17722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:22.012074 17719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:22.012521 17713 server_base.cc:1034] running on GCE node
I20260811 07:27:22.013108 17713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:22.013924 17713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:22.015101 17713 hybrid_clock.cc:648] HybridClock initialized: now 1786433242015077 us; error 44 us; skew 500 ppm
I20260811 07:27:22.017295 17713 webserver.cc:460] Webserver started at http://127.11.248.2:42047/ using document root <none> and password file <none>
I20260811 07:27:22.017904 17713 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:22.017984 17713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:22.018179 17713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:22.020542 17713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "9c3eb4ffd3964d3eb179ee1020b0b061"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "2b3563792083894bad1eca0222ce6c91"
server_key_iv: "35c54cada2b048fb364af0cb8305d879"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.021291 17713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "9c3eb4ffd3964d3eb179ee1020b0b061"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "2b3563792083894bad1eca0222ce6c91"
server_key_iv: "35c54cada2b048fb364af0cb8305d879"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.025638 17713 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:22.028520 17728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.030079 17713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:22.030251 17713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "9c3eb4ffd3964d3eb179ee1020b0b061"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "2b3563792083894bad1eca0222ce6c91"
server_key_iv: "35c54cada2b048fb364af0cb8305d879"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.030393 17713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:22.035627 17713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:22.036339 17713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:22.036545 17713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:22.037201 17713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:22.038200 17713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:22.038247 17713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.038311 17713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:22.038344 17713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.048184 17713 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:34519
I20260811 07:27:22.048285 17854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:34519 every 8 connection(s)
I20260811 07:27:22.049324 17713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:22.056540 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.051640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:39109 (local address 127.11.248.62:43283)
0811 07:27:22.051960 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.051964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.053284 (+ 1320us) server_negotiation.cc:407] Connection header received
0811 07:27:22.054710 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.054714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.054765 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.054852 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.056028 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.056032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.056035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.056048 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.056080 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.056089 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.056190 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.056337 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.056386 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178}
I20260811 07:27:22.057511 17858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.052299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43283 (local address 127.11.248.2:39109)
0811 07:27:22.053113 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.053162 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.054471 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.055029 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.055037 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.055130 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.055763 (+ 633us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.055765 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.055806 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.055875 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.056180 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.056189 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.056197 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.056385 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.056655 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":148,"threads_started":1}
I20260811 07:27:22.058161 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 17713
I20260811 07:27:22.058303 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:22.058621 12256 external_mini_cluster.cc:1428] Setting key 011f49530aa9a3618734e02808e446bb
I20260811 07:27:22.058946 17855 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43283
I20260811 07:27:22.059239 17855 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:22.059725 17855 heartbeater.cc:511] Master 127.11.248.62:43283 requested a full tablet report, sending...
I20260811 07:27:22.060602 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43283
--builtin_ntp_servers=127.11.248.20:43289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 07:27:22.061002 17500 ts_manager.cc:194] Registered new tserver with Master: 9c3eb4ffd3964d3eb179ee1020b0b061 (127.11.248.2:34519)
W20260811 07:27:22.179668 17859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:22.179973 17859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:22.180016 17859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:22.184237 17859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:22.184309 17859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:22.184368 17859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:22.189489 17859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:22.190603 17859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:22.192016 17859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:22.201748 17864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:22.201771 17867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:22.201756 17865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:22.202183 17859 server_base.cc:1034] running on GCE node
I20260811 07:27:22.202680 17859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:22.203420 17859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:22.204602 17859 hybrid_clock.cc:648] HybridClock initialized: now 1786433242204571 us; error 41 us; skew 500 ppm
I20260811 07:27:22.206712 17859 webserver.cc:460] Webserver started at http://127.11.248.3:42083/ using document root <none> and password file <none>
I20260811 07:27:22.207394 17859 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:22.207499 17859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:22.207772 17859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:22.210078 17859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "208f89f7f4804900a0770c82d3f18ff1"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "ac4dc440b2bd8e485f69f57f046a68ee"
server_key_iv: "1aa8f2fd84098a9a51cf61d62ce8b50d"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.210625 17859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "208f89f7f4804900a0770c82d3f18ff1"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "ac4dc440b2bd8e485f69f57f046a68ee"
server_key_iv: "1aa8f2fd84098a9a51cf61d62ce8b50d"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.214682 17859 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:22.217736 17874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.219192 17859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:22.219385 17859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "208f89f7f4804900a0770c82d3f18ff1"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "ac4dc440b2bd8e485f69f57f046a68ee"
server_key_iv: "1aa8f2fd84098a9a51cf61d62ce8b50d"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.219532 17859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:22.225195 17859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:22.225953 17859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:22.226171 17859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:22.226814 17859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:22.227856 17859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:22.227909 17859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.227984 17859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:22.228029 17859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.238024 17859 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:43205
I20260811 07:27:22.238047 18003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:43205 every 8 connection(s)
I20260811 07:27:22.239074 17859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:22.245950 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.241114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:47633 (local address 127.11.248.62:43283)
0811 07:27:22.241283 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.241287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.242416 (+ 1129us) server_negotiation.cc:407] Connection header received
0811 07:27:22.244033 (+ 1617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.244037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.244089 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.244214 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.245426 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.245430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.245432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.245445 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.245474 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.245483 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.245586 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.245742 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.245801 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:27:22.246894 18007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.241431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43283 (local address 127.11.248.3:47633)
0811 07:27:22.242234 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.242287 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.243796 (+ 1509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.244398 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.244406 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.244499 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.245130 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.245132 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.245171 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.245243 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.245576 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.245585 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.245591 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.245776 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.246027 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":117,"threads_started":1}
I20260811 07:27:22.248135 18004 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43283
I20260811 07:27:22.248365 18004 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:22.248682 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 17859
I20260811 07:27:22.248840 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:22.248912 18004 heartbeater.cc:511] Master 127.11.248.62:43283 requested a full tablet report, sending...
I20260811 07:27:22.249166 12256 external_mini_cluster.cc:1428] Setting key 8667ee6a9897a4627543df552e4042c4
I20260811 07:27:22.250146 17499 ts_manager.cc:194] Registered new tserver with Master: 208f89f7f4804900a0770c82d3f18ff1 (127.11.248.3:43205)
I20260811 07:27:22.251338 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:27:22.255229 17546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.253562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49392 (local address 127.11.248.62:43283)
0811 07:27:22.253714 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.253718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.253888 (+ 170us) server_negotiation.cc:407] Connection header received
0811 07:27:22.253974 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.253976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.254008 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.254079 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.254853 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.254855 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.254857 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.254869 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.254887 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.254895 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.254968 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.255034 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.255065 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:27:22.258296 17500 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:22.261433 17500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:22.273175 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.270181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:43205 (local address 127.0.0.1:40956)
0811 07:27:22.270528 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.270575 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.270675 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.271566 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.271572 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.271656 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.272267 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.272271 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.272293 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.272423 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.272742 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.272751 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.272757 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.272908 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.273008 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":114,"threads_started":1}
I20260811 07:27:22.273185 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.270360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40956 (local address 127.11.248.3:43205)
0811 07:27:22.271088 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.271100 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.271128 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:27:22.271187 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.271191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.271406 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.271571 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.272545 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.272553 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.272567 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.272581 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.272628 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.272662 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.272758 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.272939 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.273032 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":200,"threads_started":1}
I20260811 07:27:22.274296 18021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.270951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:38647 (local address 127.0.0.1:53064)
0811 07:27:22.271516 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.271531 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.271618 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.272141 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.272144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.272161 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.273557 (+ 1396us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.273559 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.273570 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.273605 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.274028 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.274031 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.274036 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.274117 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.274154 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":112,"threads_started":1}
I20260811 07:27:22.274796 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.271104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53064 (local address 127.11.248.1:38647)
0811 07:27:22.271434 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.271453 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.271714 (+ 261us) server_negotiation.cc:407] Connection header received
0811 07:27:22.271778 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.271784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.271962 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.272093 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.273756 (+ 1663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.273762 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.273773 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.273798 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.273842 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.273879 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.273986 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.274526 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.274601 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":112,"threads_started":1}
I20260811 07:27:22.275025 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.271313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34519 (local address 127.0.0.1:43982)
0811 07:27:22.272507 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.272524 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.272604 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.273932 (+ 1328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.273938 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.273955 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.274368 (+ 413us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.274373 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.274385 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.274414 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.274788 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.274791 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.274795 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.274883 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.274917 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"thread_start_us":84,"threads_started":1}
I20260811 07:27:22.275324 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.271717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.11.248.2:34519)
0811 07:27:22.272861 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.272875 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.272899 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:27:22.273026 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.273032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.273189 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.273349 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.274550 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.274555 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.274565 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.274577 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.274619 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.274648 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.274741 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.275080 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.275163 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":98,"threads_started":1}
I20260811 07:27:22.276626 17929 tablet_service.cc:1467] Processing CreateTablet for tablet 233872c2cea44d4398c02acb690e00de (DEFAULT_TABLE table=test-table [id=8757e2b3f05546e1aa2639d31253fba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:22.277866 17929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233872c2cea44d4398c02acb690e00de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:22.277913 17783 tablet_service.cc:1467] Processing CreateTablet for tablet 233872c2cea44d4398c02acb690e00de (DEFAULT_TABLE table=test-table [id=8757e2b3f05546e1aa2639d31253fba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:22.278944 17783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233872c2cea44d4398c02acb690e00de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:22.278654 17636 tablet_service.cc:1467] Processing CreateTablet for tablet 233872c2cea44d4398c02acb690e00de (DEFAULT_TABLE table=test-table [id=8757e2b3f05546e1aa2639d31253fba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:22.279611 17636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 233872c2cea44d4398c02acb690e00de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:22.284188 18025 tablet_bootstrap.cc:492] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Bootstrap starting.
I20260811 07:27:22.286005 18026 tablet_bootstrap.cc:492] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Bootstrap starting.
I20260811 07:27:22.286883 18027 tablet_bootstrap.cc:492] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: Bootstrap starting.
I20260811 07:27:22.287778 18025 tablet_bootstrap.cc:654] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:22.288193 18026 tablet_bootstrap.cc:654] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:22.288758 18025 log.cc:824] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:22.289006 18026 log.cc:824] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:22.289036 18027 tablet_bootstrap.cc:654] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:22.290294 18027 log.cc:824] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:22.290995 18026 tablet_bootstrap.cc:492] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: No bootstrap required, opened a new log
I20260811 07:27:22.290995 18025 tablet_bootstrap.cc:492] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: No bootstrap required, opened a new log
I20260811 07:27:22.291178 18026 ts_tablet_manager.cc:1397] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 07:27:22.291178 18025 ts_tablet_manager.cc:1397] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:27:22.292364 18027 tablet_bootstrap.cc:492] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: No bootstrap required, opened a new log
I20260811 07:27:22.292537 18027 ts_tablet_manager.cc:1397] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260811 07:27:22.295897 18027 raft_consensus.cc:348] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.295900 18025 raft_consensus.cc:348] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.295900 18026 raft_consensus.cc:348] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.296115 18027 raft_consensus.cc:374] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:22.296149 18027 raft_consensus.cc:729] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b914b977906b4462b99536697e2dc3a5, State: Initialized, Role: FOLLOWER
I20260811 07:27:22.296154 18026 raft_consensus.cc:374] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:22.296154 18025 raft_consensus.cc:374] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:22.296207 18025 raft_consensus.cc:729] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208f89f7f4804900a0770c82d3f18ff1, State: Initialized, Role: FOLLOWER
I20260811 07:27:22.296216 18026 raft_consensus.cc:729] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c3eb4ffd3964d3eb179ee1020b0b061, State: Initialized, Role: FOLLOWER
I20260811 07:27:22.296607 18027 consensus_queue.cc:260] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.296644 18026 consensus_queue.cc:260] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.296644 18025 consensus_queue.cc:260] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.297376 17710 heartbeater.cc:503] Master 127.11.248.62:43283 was elected leader, sending a full tablet report...
I20260811 07:27:22.297742 18025 ts_tablet_manager.cc:1428] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 07:27:22.297742 18026 ts_tablet_manager.cc:1428] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 07:27:22.297876 18004 heartbeater.cc:503] Master 127.11.248.62:43283 was elected leader, sending a full tablet report...
I20260811 07:27:22.298465 17855 heartbeater.cc:503] Master 127.11.248.62:43283 was elected leader, sending a full tablet report...
I20260811 07:27:22.299554 18027 ts_tablet_manager.cc:1428] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: Time spent starting tablet: real 0.007s user 0.001s sys 0.005s
W20260811 07:27:22.300341 17857 tablet.cc:2369] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:27:22.363970 17711 tablet.cc:2369] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:22.417182 18033 raft_consensus.cc:482] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:22.417491 18033 raft_consensus.cc:504] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.418663 18033 leader_election.cc:288] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 208f89f7f4804900a0770c82d3f18ff1 (127.11.248.3:43205), b914b977906b4462b99536697e2dc3a5 (127.11.248.1:38647)
I20260811 07:27:22.421306 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.419493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:32917 (local address 127.11.248.1:38647)
0811 07:27:22.419631 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.419636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.419772 (+ 136us) server_negotiation.cc:407] Connection header received
0811 07:27:22.419889 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.419893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.419931 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.420030 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.420770 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.420773 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.420775 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.420786 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.420807 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.420908 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.421013 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.421119 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.421166 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:22.421327 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.419317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:38647 (local address 127.11.248.2:32917)
0811 07:27:22.419680 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.419692 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.419778 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.420049 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.420052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.420066 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.420591 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.420593 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.420603 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.420628 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.421011 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.421013 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.421016 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.421109 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.421148 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":172,"threads_started":1}
I20260811 07:27:22.421353 17858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.419001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:43205 (local address 127.11.248.2:51317)
0811 07:27:22.419155 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.419173 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.419313 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.419848 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.419852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.419871 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:22.420400 (+ 529us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:22.420403 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:22.420416 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:22.420452 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:22.421057 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:22.421059 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:22.421062 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:27:22.421164 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 07:27:22.421203 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 07:27:22.421342 18020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.419085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:51317 (local address 127.11.248.3:43205)
0811 07:27:22.419239 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.419244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.419260 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:22.419638 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.419643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.419683 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.419802 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.420582 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.420587 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.420589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.420602 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.420623 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.420634 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.420736 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.421174 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.421227 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:27:22.422072 17658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233872c2cea44d4398c02acb690e00de" candidate_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b914b977906b4462b99536697e2dc3a5" is_pre_election: true
I20260811 07:27:22.422091 17952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233872c2cea44d4398c02acb690e00de" candidate_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208f89f7f4804900a0770c82d3f18ff1" is_pre_election: true
I20260811 07:27:22.422399 17952 raft_consensus.cc:2454] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c3eb4ffd3964d3eb179ee1020b0b061 in term 0.
I20260811 07:27:22.422405 17658 raft_consensus.cc:2454] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c3eb4ffd3964d3eb179ee1020b0b061 in term 0.
I20260811 07:27:22.422917 17730 leader_election.cc:302] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c3eb4ffd3964d3eb179ee1020b0b061, b914b977906b4462b99536697e2dc3a5; no voters:
I20260811 07:27:22.423172 18033 raft_consensus.cc:2781] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:22.423288 18033 raft_consensus.cc:482] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:22.423352 18033 raft_consensus.cc:3037] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:22.424752 18033 raft_consensus.cc:504] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.425268 18033 leader_election.cc:288] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [CANDIDATE]: Term 1 election: Requested vote from peers 208f89f7f4804900a0770c82d3f18ff1 (127.11.248.3:43205), b914b977906b4462b99536697e2dc3a5 (127.11.248.1:38647)
I20260811 07:27:22.425669 17658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233872c2cea44d4398c02acb690e00de" candidate_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b914b977906b4462b99536697e2dc3a5"
I20260811 07:27:22.425669 17952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "233872c2cea44d4398c02acb690e00de" candidate_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208f89f7f4804900a0770c82d3f18ff1"
I20260811 07:27:22.425782 17952 raft_consensus.cc:3037] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:22.425812 17658 raft_consensus.cc:3037] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:22.426903 17952 raft_consensus.cc:2454] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c3eb4ffd3964d3eb179ee1020b0b061 in term 1.
I20260811 07:27:22.427063 17658 raft_consensus.cc:2454] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c3eb4ffd3964d3eb179ee1020b0b061 in term 1.
I20260811 07:27:22.427206 17730 leader_election.cc:302] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208f89f7f4804900a0770c82d3f18ff1, 9c3eb4ffd3964d3eb179ee1020b0b061; no voters:
I20260811 07:27:22.427387 18033 raft_consensus.cc:2781] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:22.427608 18033 raft_consensus.cc:686] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 1 LEADER]: Becoming Leader. State: Replica: 9c3eb4ffd3964d3eb179ee1020b0b061, State: Running, Role: LEADER
I20260811 07:27:22.427989 18033 consensus_queue.cc:237] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } }
I20260811 07:27:22.431371 17500 catalog_manager.cc:5495] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c3eb4ffd3964d3eb179ee1020b0b061 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c3eb4ffd3964d3eb179ee1020b0b061" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34519 } health_report { overall_health: HEALTHY } } }
I20260811 07:27:22.466580 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.464926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43998 (local address 127.11.248.2:34519)
0811 07:27:22.465097 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.465104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.465119 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:22.465207 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.465209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.465267 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.465364 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.466118 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.466126 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.466129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.466140 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.466158 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.466167 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.466263 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.466368 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.466409 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:27:22.473785 17952 raft_consensus.cc:1261] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 1 FOLLOWER]: Refusing update from remote peer 9c3eb4ffd3964d3eb179ee1020b0b061: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:22.473779 17658 raft_consensus.cc:1261] T 233872c2cea44d4398c02acb690e00de P b914b977906b4462b99536697e2dc3a5 [term 1 FOLLOWER]: Refusing update from remote peer 9c3eb4ffd3964d3eb179ee1020b0b061: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:22.474710 18038 consensus_queue.cc:1035] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "208f89f7f4804900a0770c82d3f18ff1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:22.474948 18033 consensus_queue.cc:1035] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b914b977906b4462b99536697e2dc3a5" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 38647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:22.483350 18041 mvcc.cc:205] Tried to move back new op lower bound from 7317230561163362304 to 7317230560987967488. Current Snapshot: MvccSnapshot[applied={T|T < 7317230561163362304}]
I20260811 07:27:22.492699 17497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:22.492936 17497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:22.495671 17497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 76f928c8506c461b9bdb6271eceba813: Sending DeleteTablet for 3 replicas of tablet 233872c2cea44d4398c02acb690e00de
I20260811 07:27:22.496575 17929 tablet_service.cc:1514] Processing DeleteTablet for tablet 233872c2cea44d4398c02acb690e00de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:22 UTC) from {username='slave'} at 127.0.0.1:40956
I20260811 07:27:22.496713 17636 tablet_service.cc:1514] Processing DeleteTablet for tablet 233872c2cea44d4398c02acb690e00de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:22 UTC) from {username='slave'} at 127.0.0.1:53064
I20260811 07:27:22.497088 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 17568
I20260811 07:27:22.497500 17783 tablet_service.cc:1514] Processing DeleteTablet for tablet 233872c2cea44d4398c02acb690e00de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:22 UTC) from {username='slave'} at 127.0.0.1:43982
I20260811 07:27:22.498628 18053 tablet_replica.cc:330] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: stopping tablet replica
I20260811 07:27:22.499089 18053 raft_consensus.cc:2229] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:22.499604 18053 raft_consensus.cc:2258] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:22.500532 18051 tablet_replica.cc:330] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: stopping tablet replica
I20260811 07:27:22.500975 18051 raft_consensus.cc:2229] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:22.501374 18051 raft_consensus.cc:2258] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:22.503504 18051 ts_tablet_manager.cc:1905] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:22.504395 18053 ts_tablet_manager.cc:1905] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:22.506778 18051 ts_tablet_manager.cc:1918] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:22.506899 18051 log.cc:1196] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/233872c2cea44d4398c02acb690e00de
I20260811 07:27:22.507261 18051 ts_tablet_manager.cc:1939] T 233872c2cea44d4398c02acb690e00de P 208f89f7f4804900a0770c82d3f18ff1: Deleting consensus metadata
I20260811 07:27:22.507558 18053 ts_tablet_manager.cc:1918] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:22.507668 18053 log.cc:1196] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/233872c2cea44d4398c02acb690e00de
I20260811 07:27:22.507966 18053 ts_tablet_manager.cc:1939] T 233872c2cea44d4398c02acb690e00de P 9c3eb4ffd3964d3eb179ee1020b0b061: Deleting consensus metadata
I20260811 07:27:22.508893 17484 catalog_manager.cc:4841] TS 208f89f7f4804900a0770c82d3f18ff1 (127.11.248.3:43205): tablet 233872c2cea44d4398c02acb690e00de (table test-table [id=8757e2b3f05546e1aa2639d31253fba8]) successfully deleted
I20260811 07:27:22.509166 17484 catalog_manager.cc:4841] TS 9c3eb4ffd3964d3eb179ee1020b0b061 (127.11.248.2:34519): tablet 233872c2cea44d4398c02acb690e00de (table test-table [id=8757e2b3f05546e1aa2639d31253fba8]) successfully deleted
W20260811 07:27:22.515409 17484 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:38647 (error 108)
I20260811 07:27:22.515674 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 17713
I20260811 07:27:22.519315 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.518933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:38647 (local address 127.0.0.1:53076)
0811 07:27:22.519120 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.519210 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:38647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260811 07:27:22.519544 17484 catalog_manager.cc:4584] TS b914b977906b4462b99536697e2dc3a5 (127.11.248.1:38647): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 233872c2cea44d4398c02acb690e00de: Network error: Client connection negotiation failed: client connection to 127.11.248.1:38647: connect: Connection refused (error 111)
I20260811 07:27:22.523762 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 17859
I20260811 07:27:22.530699 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 17467
2026-08-11T07:27:22Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1110 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 07:27:22.554734 12256 mini_oidc.cc:152] Starting JWKS server
I20260811 07:27:22.556464 12256 webserver.cc:460] Webserver started at https://127.0.0.1:34903/ using document root <none> and password file <none>
I20260811 07:27:22.556667 12256 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:27:22.557030 12256 webserver.cc:460] Webserver started at http://127.0.0.1:43869/ using document root <none> and password file <none>
2026-08-11T07:27:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:22Z Disabled control of system clock
I20260811 07:27:22.569355 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34191
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:39253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:34191
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34903/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/testchainca.cert with env {}
W20260811 07:27:22.693327 18060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:22.693676 18060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:22.693756 18060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:22.697952 18060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:22.698046 18060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:22.698076 18060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:22.698113 18060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:22.698146 18060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:27:22.698196 18060 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:27:22.698228 18060 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34903/jwks.json
I20260811 07:27:22.703758 18060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:39253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:34191
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34903/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:22.705039 18060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:22.706112 18060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:22.715210 18068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:22.715251 18065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:22.715366 18060 server_base.cc:1034] running on GCE node
W20260811 07:27:22.715277 18066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:22.716120 18060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:22.717367 18060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:22.718590 18060 hybrid_clock.cc:648] HybridClock initialized: now 1786433242718562 us; error 41 us; skew 500 ppm
I20260811 07:27:22.720734 18060 webserver.cc:460] Webserver started at http://127.11.248.62:46495/ using document root <none> and password file <none>
I20260811 07:27:22.721378 18060 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:22.721450 18060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:22.721692 18060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:22.723847 18060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "1aad877c60b1445b88a8caaf1390a5c1"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "3a4636dc02a952605ac71bd4a0fb5f06"
server_key_iv: "ad50d21b425c22746ac84ff2a4e1058f"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.724493 18060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "1aad877c60b1445b88a8caaf1390a5c1"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "3a4636dc02a952605ac71bd4a0fb5f06"
server_key_iv: "ad50d21b425c22746ac84ff2a4e1058f"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.728365 18060 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 07:27:22.730993 18076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:22.732280 18060 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 07:27:22.732421 18060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "1aad877c60b1445b88a8caaf1390a5c1"
format_stamp: "Formatted at 2026-08-11 07:27:22 on dist-test-slave-77v9"
server_key: "3a4636dc02a952605ac71bd4a0fb5f06"
server_key_iv: "ad50d21b425c22746ac84ff2a4e1058f"
server_key_version: "encryptionkey@0"
I20260811 07:27:22.732543 18060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:22.750257 18060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:22.751091 18060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:22.751312 18060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:22.758962 18060 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:34191
I20260811 07:27:22.759039 18133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:34191 every 8 connection(s)
I20260811 07:27:22.759989 18060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:22.763381 18134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:22.766688 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18060
I20260811 07:27:22.766844 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:22.767165 12256 external_mini_cluster.cc:1428] Setting key 106c1cf62883784a70ed31fe8ad1752c
I20260811 07:27:22.770056 18134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1: Bootstrap starting.
I20260811 07:27:22.772555 18134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:22.773579 18134 log.cc:824] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:22.776021 18134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1: No bootstrap required, opened a new log
I20260811 07:27:22.777902 18137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.768769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41160 (local address 127.11.248.62:34191)
0811 07:27:22.769495 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.769512 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.769551 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:27:22.770322 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.770341 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.770752 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.771032 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:22.771465 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:22.772563 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:22.773915 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:22.774516 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:22.774731 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:22.775668 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:22.775676 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:22.775694 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:22.776221 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:22.776296 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:22.776323 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:22.776438 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:22.776616 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 07:27:22.776932 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":152,"threads_started":1}
I20260811 07:27:22.780733 18134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aad877c60b1445b88a8caaf1390a5c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34191 } }
I20260811 07:27:22.781055 18134 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:22.781112 18134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aad877c60b1445b88a8caaf1390a5c1, State: Initialized, Role: FOLLOWER
I20260811 07:27:22.781451 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:27:22.781641 18134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aad877c60b1445b88a8caaf1390a5c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34191 } }
I20260811 07:27:22.781804 18134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:22.781872 18134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:22.781970 18134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:22.783267 18134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aad877c60b1445b88a8caaf1390a5c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34191 } }
I20260811 07:27:22.783653 18134 leader_election.cc:302] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1aad877c60b1445b88a8caaf1390a5c1; no voters:
I20260811 07:27:22.783954 18134 leader_election.cc:288] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:22.784089 18139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:22.784369 18139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [term 1 LEADER]: Becoming Leader. State: Replica: 1aad877c60b1445b88a8caaf1390a5c1, State: Running, Role: LEADER
I20260811 07:27:22.784699 18139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aad877c60b1445b88a8caaf1390a5c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34191 } }
I20260811 07:27:22.785344 18134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:22.786507 18140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1aad877c60b1445b88a8caaf1390a5c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aad877c60b1445b88a8caaf1390a5c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34191 } } }
I20260811 07:27:22.786659 18140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:22.786947 18141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aad877c60b1445b88a8caaf1390a5c1. Latest consensus state: current_term: 1 leader_uuid: "1aad877c60b1445b88a8caaf1390a5c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aad877c60b1445b88a8caaf1390a5c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34191 } } }
I20260811 07:27:22.787063 18141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:22.787223 18148 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:22.790691 18148 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:22.796947 18148 catalog_manager.cc:1347] Generated new cluster ID: 9253dd96661444bca0f71275e6913b5a
I20260811 07:27:22.797050 18148 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:22.804198 18148 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:22.805294 18148 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:22.812551 18148 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1aad877c60b1445b88a8caaf1390a5c1: Generated new TSK 0
I20260811 07:27:22.813520 18148 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:27:22.845373 18165 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 07:27:22.845575 18165 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:27:22.846124 18137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:22.827584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41164 (local address 127.11.248.62:34191)
0811 07:27:22.827727 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:22.827732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:22.828063 (+ 331us) server_negotiation.cc:407] Connection header received
0811 07:27:22.828312 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:22.828316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:22.828375 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:22.828457 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:27:22.828906 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:22.829474 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:22.830765 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:22.831043 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:22.831131 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:22.831606 (+ 475us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:27:22.845720 (+ 14114us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:27:22.846008 (+ 288us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41164: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 07:27:22.846215 18137 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41164: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 07:27:22.848312 18164 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:22.827400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34191 (local address 127.0.0.1:41164)
0811 07:27:22.827946 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:22.827963 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:22.828114 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:22.828512 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:22.828516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:22.828525 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:27:22.828663 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:22.828670 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:22.829601 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:22.829605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:22.830610 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:22.830621 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:22.831178 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:22.831182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:22.831283 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:22.831347 (+ 64us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:27:22.846019 (+ 14672us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:27:22.846300 (+ 281us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.248.62:34191: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":131,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.248.62:34191: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34903/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 07:27:22.849143 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18060
2026-08-11T07:27:22Z chronyd exiting
I20260811 07:27:22.891997 12256 test_util.cc:175] -----------------------------------------------
I20260811 07:27:22.892112 12256 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433213255187-12256-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (339 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 07:27:22.893429 12256 mini_oidc.cc:152] Starting JWKS server
I20260811 07:27:22.894346 12256 webserver.cc:460] Webserver started at https://127.0.0.1:37155/ using document root <none> and password file <none>
I20260811 07:27:22.894452 12256 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:27:22.894688 12256 webserver.cc:460] Webserver started at http://127.0.0.1:40025/ using document root <none> and password file <none>
2026-08-11T07:27:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:22Z Disabled control of system clock
I20260811 07:27:22.906608 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39847
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:39847
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37155/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/testchainca.cert with env {}
W20260811 07:27:23.026984 18171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:23.027292 18171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:23.027335 18171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:23.031599 18171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:23.031687 18171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:23.031702 18171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:23.031719 18171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:23.031735 18171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:27:23.031751 18171 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:27:23.031765 18171 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37155/jwks.json
I20260811 07:27:23.037528 18171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:39847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37155/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:23.038723 18171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:23.039848 18171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:23.049216 18179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:23.049220 18177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:23.049216 18176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:23.049319 18171 server_base.cc:1034] running on GCE node
I20260811 07:27:23.050055 18171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:23.051568 18171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:23.052904 18171 hybrid_clock.cc:648] HybridClock initialized: now 1786433243052877 us; error 47 us; skew 500 ppm
I20260811 07:27:23.055042 18171 webserver.cc:460] Webserver started at http://127.11.248.62:39361/ using document root <none> and password file <none>
I20260811 07:27:23.055666 18171 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:23.055857 18171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:23.056106 18171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:23.058352 18171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "407ae7129a09426c828b0a86e8675bd3"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "89767b1cd45a120bac423485f5869cb4"
server_key_iv: "3c00c45e2c78f91dfc3d7f06cd887038"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.058964 18171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "407ae7129a09426c828b0a86e8675bd3"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "89767b1cd45a120bac423485f5869cb4"
server_key_iv: "3c00c45e2c78f91dfc3d7f06cd887038"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.063056 18171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:23.065929 18185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:23.067340 18171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:23.067526 18171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "407ae7129a09426c828b0a86e8675bd3"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "89767b1cd45a120bac423485f5869cb4"
server_key_iv: "3c00c45e2c78f91dfc3d7f06cd887038"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.067677 18171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:23.088387 18171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:23.089339 18171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:23.089596 18171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:23.098435 18171 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:39847
I20260811 07:27:23.098512 18244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:39847 every 8 connection(s)
I20260811 07:27:23.099551 18171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:23.103008 18247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:23.105743 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18171
I20260811 07:27:23.105913 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:23.106246 12256 external_mini_cluster.cc:1428] Setting key a35c5136fe70382186681eafdfacb69e
I20260811 07:27:23.111059 18247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3: Bootstrap starting.
I20260811 07:27:23.113842 18247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:23.114634 18247 log.cc:824] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:23.116271 18250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:23.107671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60536 (local address 127.11.248.62:39847)
0811 07:27:23.108346 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:23.108369 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:23.108415 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:27:23.109244 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:23.109264 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:23.109726 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:23.110072 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:23.110515 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.111560 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.112476 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.113039 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.113215 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.114351 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:23.114356 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:23.114369 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:23.114804 (+ 435us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:23.114920 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:23.114944 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:23.115053 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:23.115224 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:27:23.115528 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260811 07:27:23.116948 18247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3: No bootstrap required, opened a new log
I20260811 07:27:23.119719 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:27:23.122225 18247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "407ae7129a09426c828b0a86e8675bd3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39847 } }
I20260811 07:27:23.122504 18247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:23.122545 18247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 407ae7129a09426c828b0a86e8675bd3, State: Initialized, Role: FOLLOWER
I20260811 07:27:23.122946 18247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "407ae7129a09426c828b0a86e8675bd3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39847 } }
I20260811 07:27:23.123063 18247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:23.123108 18247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:23.123178 18247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:23.124244 18247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "407ae7129a09426c828b0a86e8675bd3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39847 } }
I20260811 07:27:23.124573 18247 leader_election.cc:302] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 407ae7129a09426c828b0a86e8675bd3; no voters:
I20260811 07:27:23.124980 18247 leader_election.cc:288] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:23.125164 18252 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:23.125758 18252 raft_consensus.cc:686] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [term 1 LEADER]: Becoming Leader. State: Replica: 407ae7129a09426c828b0a86e8675bd3, State: Running, Role: LEADER
I20260811 07:27:23.126116 18252 consensus_queue.cc:237] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "407ae7129a09426c828b0a86e8675bd3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39847 } }
I20260811 07:27:23.126816 18247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:23.127946 18254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 407ae7129a09426c828b0a86e8675bd3. Latest consensus state: current_term: 1 leader_uuid: "407ae7129a09426c828b0a86e8675bd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "407ae7129a09426c828b0a86e8675bd3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39847 } } }
I20260811 07:27:23.128105 18254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:23.128408 18253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "407ae7129a09426c828b0a86e8675bd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "407ae7129a09426c828b0a86e8675bd3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39847 } } }
I20260811 07:27:23.128522 18253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:23.128530 18261 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:23.132234 18261 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:23.138445 18261 catalog_manager.cc:1347] Generated new cluster ID: 8a443cdf86c7422591d56195767d9681
I20260811 07:27:23.138536 18261 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:23.151098 18261 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:23.152099 18261 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:23.161429 18261 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 407ae7129a09426c828b0a86e8675bd3: Generated new TSK 0
I20260811 07:27:23.162197 18261 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:27:23.197845 18278 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 07:27:23.197971 18278 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:27:23.198992 18250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:23.174293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60546 (local address 127.11.248.62:39847)
0811 07:27:23.174446 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:23.174453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:23.174642 (+ 189us) server_negotiation.cc:407] Connection header received
0811 07:27:23.175036 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:23.175042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:23.175108 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:23.175265 (+ 157us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:27:23.175560 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.176272 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.177372 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.177640 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.177774 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.178145 (+ 371us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:27:23.198397 (+ 20252us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37155/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:27:23.198790 (+ 393us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60546: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37155/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 07:27:23.199102 18277 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:23.174188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39847 (local address 127.0.0.1:60546)
0811 07:27:23.174547 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:23.174560 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:23.174707 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:23.175273 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:23.175277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:23.175286 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:27:23.175428 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:23.175434 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.176424 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.176432 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:23.177225 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:23.177236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.177798 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.177803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:23.177910 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.177937 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:27:23.198663 (+ 20726us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37155/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:27:23.198888 (+ 225us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.248.62:39847: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37155/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":137,"threads_started":1}
W20260811 07:27:23.199095 18250 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60546: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37155/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 07:27:23.199867 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18171
2026-08-11T07:27:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (351 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 07:27:23.244423 12256 mini_oidc.cc:152] Starting JWKS server
I20260811 07:27:23.245498 12256 webserver.cc:460] Webserver started at https://127.0.0.1:35125/ using document root <none> and password file <none>
I20260811 07:27:23.245605 12256 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:27:23.245929 12256 webserver.cc:460] Webserver started at http://127.0.0.1:41891/ using document root <none> and password file <none>
2026-08-11T07:27:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:23Z Disabled control of system clock
I20260811 07:27:23.257648 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43111
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:41889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:43111
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35125/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:27:23.381717 18284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:23.382033 18284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:23.382076 18284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:23.386312 18284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:23.386392 18284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:23.386408 18284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:23.386425 18284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:23.386441 18284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:27:23.386476 18284 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:27:23.386490 18284 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35125/jwks.json
I20260811 07:27:23.391621 18284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:43111
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35125/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:23.392853 18284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:23.394379 18284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:23.403255 18292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:23.403225 18290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:23.403708 18289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:23.404052 18284 server_base.cc:1034] running on GCE node
I20260811 07:27:23.404712 18284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:23.405921 18284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:23.407090 18284 hybrid_clock.cc:648] HybridClock initialized: now 1786433243407071 us; error 32 us; skew 500 ppm
I20260811 07:27:23.409170 18284 webserver.cc:460] Webserver started at http://127.11.248.62:42711/ using document root <none> and password file <none>
I20260811 07:27:23.409790 18284 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:23.409862 18284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:23.410092 18284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:23.412279 18284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "70fd6477bc114b67909ee6c564a163f3"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "72271939b575c1d63bc44b5634819113"
server_key_iv: "7dbdff5f4c7ed48e354a969ca28e6947"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.412967 18284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "70fd6477bc114b67909ee6c564a163f3"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "72271939b575c1d63bc44b5634819113"
server_key_iv: "7dbdff5f4c7ed48e354a969ca28e6947"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.416929 18284 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:23.419852 18298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:23.421458 18284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:23.421629 18284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "70fd6477bc114b67909ee6c564a163f3"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "72271939b575c1d63bc44b5634819113"
server_key_iv: "7dbdff5f4c7ed48e354a969ca28e6947"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.421788 18284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:23.441962 18284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:23.442795 18284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:23.443025 18284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:23.451571 18355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:43111 every 8 connection(s)
I20260811 07:27:23.451572 18284 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:43111
I20260811 07:27:23.452889 18284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:23.455014 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18284
I20260811 07:27:23.455154 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:23.455488 12256 external_mini_cluster.cc:1428] Setting key 580d33139f5febfc11ee617c1eabbb39
I20260811 07:27:23.456753 18357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:23.464118 18357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3: Bootstrap starting.
I20260811 07:27:23.467283 18357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:23.467543 18360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:23.457138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43366 (local address 127.11.248.62:43111)
0811 07:27:23.457871 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:23.457892 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:23.457940 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:27:23.458909 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:23.458934 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:23.459477 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:23.459871 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:23.460344 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.461866 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.463051 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.463743 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.463908 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.465232 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:23.465238 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:23.465256 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:23.465833 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:23.465907 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:23.465936 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:23.466041 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:23.466221 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 07:27:23.466533 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":141,"threads_started":1}
I20260811 07:27:23.468250 18357 log.cc:824] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:23.470639 18357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3: No bootstrap required, opened a new log
I20260811 07:27:23.470850 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:27:23.475072 18357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fd6477bc114b67909ee6c564a163f3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43111 } }
I20260811 07:27:23.475381 18357 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:23.475442 18357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70fd6477bc114b67909ee6c564a163f3, State: Initialized, Role: FOLLOWER
I20260811 07:27:23.475922 18357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fd6477bc114b67909ee6c564a163f3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43111 } }
I20260811 07:27:23.476074 18357 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:23.476143 18357 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:23.476218 18357 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:23.477341 18357 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fd6477bc114b67909ee6c564a163f3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43111 } }
I20260811 07:27:23.477743 18357 leader_election.cc:302] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70fd6477bc114b67909ee6c564a163f3; no voters:
I20260811 07:27:23.478168 18357 leader_election.cc:288] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:23.478339 18362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:23.478612 18362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [term 1 LEADER]: Becoming Leader. State: Replica: 70fd6477bc114b67909ee6c564a163f3, State: Running, Role: LEADER
I20260811 07:27:23.478967 18362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fd6477bc114b67909ee6c564a163f3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43111 } }
I20260811 07:27:23.479557 18357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:23.480763 18364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70fd6477bc114b67909ee6c564a163f3. Latest consensus state: current_term: 1 leader_uuid: "70fd6477bc114b67909ee6c564a163f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fd6477bc114b67909ee6c564a163f3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43111 } } }
I20260811 07:27:23.480938 18364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:23.481221 18363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70fd6477bc114b67909ee6c564a163f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70fd6477bc114b67909ee6c564a163f3" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43111 } } }
I20260811 07:27:23.481333 18363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3 [sys.catalog]: This master's current role is: LEADER
W20260811 07:27:23.484337 18380 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:27:23.484411 18380 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:27:23.484508 18371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:23.485267 18371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:23.490846 18371 catalog_manager.cc:1347] Generated new cluster ID: 0c75ecc41f6d4325840a9163772de23d
I20260811 07:27:23.490944 18371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:23.495864 18371 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:23.496759 18371 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:23.508368 18371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70fd6477bc114b67909ee6c564a163f3: Generated new TSK 0
I20260811 07:27:23.509462 18371 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:23.526444 18360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:23.520970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43380 (local address 127.11.248.62:43111)
0811 07:27:23.521106 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:23.521110 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:23.521271 (+ 161us) server_negotiation.cc:407] Connection header received
0811 07:27:23.521414 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:23.521417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:23.521483 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:23.521629 (+ 146us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:27:23.521852 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.522668 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.523570 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.523926 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.524042 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.524345 (+ 303us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:27:23.525974 (+ 1629us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35125/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:27:23.526287 (+ 313us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43380: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35125/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 07:27:23.526549 18360 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43380: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35125/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 07:27:23.528277 18390 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:23.520852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43111 (local address 127.0.0.1:43380)
0811 07:27:23.521166 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:23.521180 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:23.521284 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:23.521629 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:23.521631 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:23.521638 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:27:23.521737 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:23.521742 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.522806 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.522809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:23.523446 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:23.523453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.524051 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.524054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:23.524124 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.524147 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:27:23.526207 (+ 2060us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35125/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:27:23.528101 (+ 1894us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.248.62:43111: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35125/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":1682,"thread_start_us":121,"threads_started":1}
I20260811 07:27:23.528928 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18284
E20260811 07:27:23.539513 18391 webserver.cc:533] Webserver: sslize failed:
E20260811 07:27:23.539608 18391 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T07:27:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (327 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T07:27:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:23Z Disabled control of system clock
I20260811 07:27:23.583670 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:33171
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:41927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:33171
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/testchainca.cert with env {}
W20260811 07:27:23.697932 18395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:23.698302 18395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:23.698390 18395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:23.702585 18395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:23.702713 18395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:23.702745 18395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:23.702783 18395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:23.702845 18395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:27:23.702885 18395 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:27:23.702919 18395 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 07:27:23.708714 18395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:33171
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:33171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:23.709995 18395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:23.711120 18395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:23.720340 18401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:23.720382 18403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:23.720340 18400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:23.720916 18395 server_base.cc:1034] running on GCE node
I20260811 07:27:23.721585 18395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:23.722885 18395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:23.724085 18395 hybrid_clock.cc:648] HybridClock initialized: now 1786433243724064 us; error 33 us; skew 500 ppm
I20260811 07:27:23.726167 18395 webserver.cc:460] Webserver started at http://127.11.248.62:37049/ using document root <none> and password file <none>
I20260811 07:27:23.726830 18395 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:23.726933 18395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:23.727152 18395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:23.729417 18395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "3a7f16c6da6c4c5e83b80201f44f2618"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "a78148cc431b55fda649bca091649fdc"
server_key_iv: "e468c5e3e116684b9d561e3638db7a3a"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.730013 18395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "3a7f16c6da6c4c5e83b80201f44f2618"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "a78148cc431b55fda649bca091649fdc"
server_key_iv: "e468c5e3e116684b9d561e3638db7a3a"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.733918 18395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:23.736626 18410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:23.738201 18395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:23.738411 18395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "3a7f16c6da6c4c5e83b80201f44f2618"
format_stamp: "Formatted at 2026-08-11 07:27:23 on dist-test-slave-77v9"
server_key: "a78148cc431b55fda649bca091649fdc"
server_key_iv: "e468c5e3e116684b9d561e3638db7a3a"
server_key_version: "encryptionkey@0"
I20260811 07:27:23.738570 18395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:23.763368 18395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:23.764283 18395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:23.764547 18395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:23.773479 18395 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:33171
I20260811 07:27:23.773483 18464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:33171 every 8 connection(s)
I20260811 07:27:23.774631 18395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:23.777834 18465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:23.781307 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18395
I20260811 07:27:23.781473 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:23.781766 12256 external_mini_cluster.cc:1428] Setting key 8dab62e669317fd78c63968abb4eb5f6
I20260811 07:27:23.784315 18465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618: Bootstrap starting.
I20260811 07:27:23.787439 18465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:23.788455 18465 log.cc:824] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:23.791105 18465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618: No bootstrap required, opened a new log
I20260811 07:27:23.792934 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:23.783368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41114 (local address 127.11.248.62:33171)
0811 07:27:23.784125 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:23.784148 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:23.784196 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:27:23.785141 (+ 945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:23.785167 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:23.785765 (+ 598us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:23.786175 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:23.786685 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.788259 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.789380 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.789896 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.790032 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.791001 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:23.791007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:23.791020 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:23.791486 (+ 466us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:23.791544 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:23.791570 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:23.791646 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:23.791826 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 07:27:23.792139 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":130,"threads_started":1}
I20260811 07:27:23.795131 18465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33171 } }
I20260811 07:27:23.795393 18465 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:23.795475 18465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a7f16c6da6c4c5e83b80201f44f2618, State: Initialized, Role: FOLLOWER
I20260811 07:27:23.795857 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:27:23.795974 18465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33171 } }
I20260811 07:27:23.796171 18465 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:23.796243 18465 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:23.796345 18465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:23.797451 18465 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33171 } }
I20260811 07:27:23.797806 18465 leader_election.cc:302] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a7f16c6da6c4c5e83b80201f44f2618; no voters:
I20260811 07:27:23.798156 18465 leader_election.cc:288] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:23.798357 18470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:23.798784 18470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [term 1 LEADER]: Becoming Leader. State: Replica: 3a7f16c6da6c4c5e83b80201f44f2618, State: Running, Role: LEADER
I20260811 07:27:23.799149 18470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33171 } }
I20260811 07:27:23.799394 18465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:23.800576 18472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a7f16c6da6c4c5e83b80201f44f2618. Latest consensus state: current_term: 1 leader_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33171 } } }
I20260811 07:27:23.800742 18472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:23.801160 18471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7f16c6da6c4c5e83b80201f44f2618" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 33171 } } }
I20260811 07:27:23.801273 18471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618 [sys.catalog]: This master's current role is: LEADER
W20260811 07:27:23.804884 18486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:27:23.804988 18486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:27:23.805078 18480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:23.805812 18480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:23.811689 18480 catalog_manager.cc:1347] Generated new cluster ID: 796b17eef20246c4975f5a711995677e
I20260811 07:27:23.811774 18480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:23.823272 18480 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:23.824644 18480 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:23.830396 18480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a7f16c6da6c4c5e83b80201f44f2618: Generated new TSK 0
I20260811 07:27:23.831149 18480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:24.697609 18468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:23.842211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41122 (local address 127.11.248.62:33171)
0811 07:27:23.842367 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:23.842372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:23.842583 (+ 211us) server_negotiation.cc:407] Connection header received
0811 07:27:23.842735 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:23.842738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:23.842830 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:23.842962 (+ 132us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:27:23.843277 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.844140 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.845176 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.845535 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.845642 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.845968 (+ 326us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:27:24.697146 (+851178us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:27:24.697477 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41122: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 07:27:24.697755 18468 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41122: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 07:27:24.697836 18495 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:23.842136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:33171 (local address 127.0.0.1:41122)
0811 07:27:23.842473 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:23.842497 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:23.842608 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:23.842950 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:23.842952 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:23.842961 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:27:23.843067 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:23.843072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.844295 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.844298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:23.845058 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:23.845068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:23.845668 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:23.845671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:23.845740 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:23.845768 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:27:24.697405 (+851637us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:27:24.697645 (+ 240us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.248.62:33171: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":134,"threads_started":1}
I20260811 07:27:24.698485 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18395
2026-08-11T07:27:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1149 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (142 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (138 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:25 dist-test-slave-77v9 krb5kdc[18507](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:25 dist-test-slave-77v9 krb5kdc[18507](info): set up 2 sockets
Aug 11 07:27:25 dist-test-slave-77v9 krb5kdc[18507](info): commencing operation
krb5kdc: starting...
W20260811 07:27:26.096978 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:26.241183 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35635
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:35635
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:26.359033 18526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:26.359385 18526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:26.359474 18526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:26.363749 18526 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:26.363859 18526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:26.363896 18526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:26.363960 18526 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:26.363997 18526 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:26.369748 18526 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:35635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:26.370987 18526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:26.372092 18526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:26.381184 18532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:26.381184 18533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:26.381184 18535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:26.381692 18526 server_base.cc:1034] running on GCE node
I20260811 07:27:26.382329 18526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:26.383567 18526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:26.384795 18526 hybrid_clock.cc:648] HybridClock initialized: now 1786433246384765 us; error 40 us; skew 500 ppm
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:26.391428 18526 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:26.392555 18526 webserver.cc:460] Webserver started at http://127.11.248.62:40491/ using document root <none> and password file <none>
I20260811 07:27:26.393298 18526 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:26.393411 18526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:26.393666 18526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:26.395941 18526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "64d2243dbcd44ee39f90d60c4764781f"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "d6bc34d68ecc58fddd9ee72eee37f6fc"
server_key_iv: "e08a7e99a77ace88771db7b0730edb59"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.396590 18526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "64d2243dbcd44ee39f90d60c4764781f"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "d6bc34d68ecc58fddd9ee72eee37f6fc"
server_key_iv: "e08a7e99a77ace88771db7b0730edb59"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.400715 18526 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:27:26.403448 18542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.404942 18526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:27:26.405169 18526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "64d2243dbcd44ee39f90d60c4764781f"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "d6bc34d68ecc58fddd9ee72eee37f6fc"
server_key_iv: "e08a7e99a77ace88771db7b0730edb59"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.405314 18526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:26.433669 18526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:26.437565 18526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:26.437836 18526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:26.446473 18526 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:35635
I20260811 07:27:26.446502 18600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:35635 every 8 connection(s)
I20260811 07:27:26.447625 18526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:26.449667 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18526
I20260811 07:27:26.449798 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:26.450248 12256 external_mini_cluster.cc:1428] Setting key fc961efca4e672d7f7b4cd04c41ddcd6
I20260811 07:27:26.451053 18601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:26.458981 18601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f: Bootstrap starting.
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:26.461951 18601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:26.463070 18601 log.cc:824] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:26.465979 18601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f: No bootstrap required, opened a new log
I20260811 07:27:26.468611 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:26.451864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.11.248.62:35635)
0811 07:27:26.452345 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:26.452364 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:26.452419 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:27:26.453325 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:26.453351 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:26.453798 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:26.454194 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:26.454926 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.456459 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.457679 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.458548 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.458743 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:26.462108 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:26.462115 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:26.462138 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:26.462183 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:26.464462 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:26.465153 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:26.465160 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:26.465167 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:26.465340 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:26.465717 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:26.465720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:26.465722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:26.466322 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:26.466568 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:26.466864 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 07:27:26.467217 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":135,"threads_started":1}
I20260811 07:27:26.470624 18601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d2243dbcd44ee39f90d60c4764781f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35635 } }
I20260811 07:27:26.470904 18601 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:26.470947 18601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64d2243dbcd44ee39f90d60c4764781f, State: Initialized, Role: FOLLOWER
I20260811 07:27:26.471433 18601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d2243dbcd44ee39f90d60c4764781f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35635 } }
I20260811 07:27:26.471613 18601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:26.471719 18601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:26.471886 18601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:26.473062 18601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d2243dbcd44ee39f90d60c4764781f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35635 } }
I20260811 07:27:26.473451 18601 leader_election.cc:302] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64d2243dbcd44ee39f90d60c4764781f; no voters:
I20260811 07:27:26.473906 18601 leader_election.cc:288] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:26.474145 18606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:26.474642 18606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [term 1 LEADER]: Becoming Leader. State: Replica: 64d2243dbcd44ee39f90d60c4764781f, State: Running, Role: LEADER
I20260811 07:27:26.475026 18606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d2243dbcd44ee39f90d60c4764781f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35635 } }
I20260811 07:27:26.475440 18601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:26.477067 18608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64d2243dbcd44ee39f90d60c4764781f. Latest consensus state: current_term: 1 leader_uuid: "64d2243dbcd44ee39f90d60c4764781f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d2243dbcd44ee39f90d60c4764781f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35635 } } }
I20260811 07:27:26.477279 18608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:26.478070 18607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64d2243dbcd44ee39f90d60c4764781f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64d2243dbcd44ee39f90d60c4764781f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35635 } } }
I20260811 07:27:26.478654 18607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f [sys.catalog]: This master's current role is: LEADER
W20260811 07:27:26.481518 18624 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:27:26.481608 18624 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:27:26.481745 18618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:26.482671 18618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:26.488854 18618 catalog_manager.cc:1347] Generated new cluster ID: 44a67860703f4633b6d3eb526ed1192f
I20260811 07:27:26.488934 18618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:26.519122 18618 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:26.520233 18618 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:26.529135 18618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64d2243dbcd44ee39f90d60c4764781f: Generated new TSK 0
I20260811 07:27:26.529928 18618 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:26.569034 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35635
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:26.688308 18630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:26.688658 18630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:26.688740 18630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:26.693037 18630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:26.693145 18630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:26.693248 18630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:26.698784 18630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:26.699987 18630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:26.701108 18630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:26.711531 18635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:26.711547 18636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:26.711591 18638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:26.711905 18630 server_base.cc:1034] running on GCE node
I20260811 07:27:26.712395 18630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:26.713184 18630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:26.714396 18630 hybrid_clock.cc:648] HybridClock initialized: now 1786433246714361 us; error 49 us; skew 500 ppm
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:26.717578 18630 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:26.718598 18630 webserver.cc:460] Webserver started at http://127.11.248.1:44083/ using document root <none> and password file <none>
I20260811 07:27:26.719188 18630 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:26.719272 18630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:26.719494 18630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:26.721935 18630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "6644b048a4e64ec39b147dbdc0851f4c"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "1e63e06477bc02b54b98cbf3f686d245"
server_key_iv: "a7d85fba770bc187de86eea1f198f36b"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.722584 18630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "6644b048a4e64ec39b147dbdc0851f4c"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "1e63e06477bc02b54b98cbf3f686d245"
server_key_iv: "a7d85fba770bc187de86eea1f198f36b"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.727089 18630 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:26.730171 18645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.731657 18630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:27:26.731968 18630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "6644b048a4e64ec39b147dbdc0851f4c"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "1e63e06477bc02b54b98cbf3f686d245"
server_key_iv: "a7d85fba770bc187de86eea1f198f36b"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.732108 18630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:26.741529 18630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:26.745077 18630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:26.745299 18630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:26.745940 18630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:26.746829 18630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:26.746913 18630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.746989 18630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:26.747040 18630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.756004 18630 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:42171
I20260811 07:27:26.756062 18769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:42171 every 8 connection(s)
I20260811 07:27:26.757059 18630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:26.758019 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18630
I20260811 07:27:26.758176 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:26.758541 12256 external_mini_cluster.cc:1428] Setting key 3449ca4e5d96289f61b2e1d9dcacf86f
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:27:26.774551 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:26.759390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:44213 (local address 127.11.248.62:35635)
0811 07:27:26.759543 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:26.759548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:26.760637 (+ 1089us) server_negotiation.cc:407] Connection header received
0811 07:27:26.762754 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:26.762759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:26.762825 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:26.762925 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:26.764133 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.765043 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.766299 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.766811 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.766958 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:26.769821 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:26.769827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:26.769831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:26.769866 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:26.771458 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:26.772350 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:26.772353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:26.772354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:26.772475 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:26.773004 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:26.773007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:26.773008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:26.773295 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:26.773417 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:26.774117 (+ 700us) server_negotiation.cc:299] Negotiation successful
0811 07:27:26.774286 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:27:26.775925 18772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:26.759855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35635 (local address 127.11.248.1:44213)
0811 07:27:26.760453 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:26.760511 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:26.762471 (+ 1960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:26.763075 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:26.763082 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:26.763435 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:26.763971 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:26.763986 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.765190 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.765193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:26.766167 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:26.766177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.766983 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.766986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:26.767136 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:26.767807 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:26.767824 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:26.769623 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:26.771577 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:26.771583 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:26.771596 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:26.771952 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:26.772576 (+ 624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:26.772578 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:26.772580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:26.772731 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:26.773419 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:26.773425 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:26.773748 (+ 323us) client_negotiation.cc:769] Sending connection context
0811 07:27:26.773997 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 07:27:26.774415 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":168,"threads_started":1}
I20260811 07:27:26.777873 18770 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35635
I20260811 07:27:26.778165 18770 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:26.778723 18770 heartbeater.cc:511] Master 127.11.248.62:35635 requested a full tablet report, sending...
I20260811 07:27:26.780405 18560 ts_manager.cc:194] Registered new tserver with Master: 6644b048a4e64ec39b147dbdc0851f4c (127.11.248.1:42171)
I20260811 07:27:26.781669 18560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:44213
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:26.794319 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35635
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:26.911497 18775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:26.911763 18775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:26.911809 18775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:26.915995 18775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:26.916067 18775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:26.916127 18775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:26.921586 18775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:26.922734 18775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:26.923834 18775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:26.934134 18781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:26.934161 18784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:26.934435 18775 server_base.cc:1034] running on GCE node
W20260811 07:27:26.934134 18780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:26.934883 18775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:26.935604 18775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:26.936801 18775 hybrid_clock.cc:648] HybridClock initialized: now 1786433246936771 us; error 41 us; skew 500 ppm
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:26.939945 18775 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:26.941051 18775 webserver.cc:460] Webserver started at http://127.11.248.2:33063/ using document root <none> and password file <none>
I20260811 07:27:26.941715 18775 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:26.941951 18775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:26.942212 18775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:26.944360 18775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "5bfa82ebad7743af9b6b9825b394f311"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "e0efa998ac756d4b2b7ab9f3072a0268"
server_key_iv: "8cbfbb337ae4fd493c1b9fd6c04f7895"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.945003 18775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "5bfa82ebad7743af9b6b9825b394f311"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "e0efa998ac756d4b2b7ab9f3072a0268"
server_key_iv: "8cbfbb337ae4fd493c1b9fd6c04f7895"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.948997 18775 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:27:26.951566 18792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.952919 18775 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:26.953058 18775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "5bfa82ebad7743af9b6b9825b394f311"
format_stamp: "Formatted at 2026-08-11 07:27:26 on dist-test-slave-77v9"
server_key: "e0efa998ac756d4b2b7ab9f3072a0268"
server_key_iv: "8cbfbb337ae4fd493c1b9fd6c04f7895"
server_key_version: "encryptionkey@0"
I20260811 07:27:26.953194 18775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:26.964129 18775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:26.967633 18775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:26.967799 18775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:26.968354 18775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:26.969220 18775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:26.969278 18775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.969319 18775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:26.969334 18775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:26.978950 18775 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:38531
I20260811 07:27:26.978967 18916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:38531 every 8 connection(s)
I20260811 07:27:26.979949 18775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:26.982713 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18775
I20260811 07:27:26.982849 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:26.983249 12256 external_mini_cluster.cc:1428] Setting key cac583b2865f4761015093d92d002842
Aug 11 07:27:26 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433246, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:26.996454 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:26.981964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:39195 (local address 127.11.248.62:35635)
0811 07:27:26.982118 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:26.982121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:26.983211 (+ 1090us) server_negotiation.cc:407] Connection header received
0811 07:27:26.985043 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:26.985046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:26.985103 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:26.985198 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:26.986395 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.987270 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.989110 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.989342 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.989429 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:26.992555 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:26.992558 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:26.992561 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:26.992588 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:26.994139 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:26.994692 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:26.994696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:26.994698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:26.994785 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:26.995140 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:26.995145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:26.995146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:26.995351 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:26.995491 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:26.996115 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 07:27:26.996253 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:27:26.997437 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:26.982458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35635 (local address 127.11.248.2:39195)
0811 07:27:26.983010 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:26.983075 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:26.984773 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:26.985355 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:26.985362 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:26.985744 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:26.986238 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:26.986251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.987431 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.987436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:26.988980 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:26.988995 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:26.989514 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:26.989521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:26.989767 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:26.990451 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:26.990476 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:26.992362 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:26.994270 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:26.994278 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:26.994295 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:26.994597 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:26.994885 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:26.994888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:26.994890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:26.995041 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:26.995503 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:26.995511 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:26.995859 (+ 348us) client_negotiation.cc:769] Sending connection context
0811 07:27:26.996069 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 07:27:26.996428 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":126,"threads_started":1}
I20260811 07:27:26.998713 18917 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35635
I20260811 07:27:26.998996 18917 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:26.999639 18917 heartbeater.cc:511] Master 127.11.248.62:35635 requested a full tablet report, sending...
I20260811 07:27:27.001032 18560 ts_manager.cc:194] Registered new tserver with Master: 5bfa82ebad7743af9b6b9825b394f311 (127.11.248.2:38531)
I20260811 07:27:27.001680 18560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:39195
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:27.016911 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35635
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:27.137670 18922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:27.137970 18922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:27.138016 18922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:27.142134 18922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:27.142208 18922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:27.142269 18922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:27.147724 18922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:27.148878 18922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:27.149914 18922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:27.160161 18927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:27.160370 18922 server_base.cc:1034] running on GCE node
W20260811 07:27:27.160161 18928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:27.160588 18931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:27.161079 18922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:27.161823 18922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:27.163007 18922 hybrid_clock.cc:648] HybridClock initialized: now 1786433247162988 us; error 32 us; skew 500 ppm
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.166200 18922 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:27.167224 18922 webserver.cc:460] Webserver started at http://127.11.248.3:45693/ using document root <none> and password file <none>
I20260811 07:27:27.167836 18922 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:27.168031 18922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:27.168275 18922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:27.170499 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "410a4556fa3744aa9393607869bd7489"
format_stamp: "Formatted at 2026-08-11 07:27:27 on dist-test-slave-77v9"
server_key: "af282f15b9c81351649a25e5c78db9fb"
server_key_iv: "e9c502e5f0dd0aac1c31593f713c639f"
server_key_version: "encryptionkey@0"
I20260811 07:27:27.171116 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "410a4556fa3744aa9393607869bd7489"
format_stamp: "Formatted at 2026-08-11 07:27:27 on dist-test-slave-77v9"
server_key: "af282f15b9c81351649a25e5c78db9fb"
server_key_iv: "e9c502e5f0dd0aac1c31593f713c639f"
server_key_version: "encryptionkey@0"
I20260811 07:27:27.175200 18922 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:27.178102 18938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:27.179394 18922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:27.179538 18922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "410a4556fa3744aa9393607869bd7489"
format_stamp: "Formatted at 2026-08-11 07:27:27 on dist-test-slave-77v9"
server_key: "af282f15b9c81351649a25e5c78db9fb"
server_key_iv: "e9c502e5f0dd0aac1c31593f713c639f"
server_key_version: "encryptionkey@0"
I20260811 07:27:27.179661 18922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:27.196168 18922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:27.199683 18922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:27.199934 18922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:27.200582 18922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:27.201524 18922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:27.201601 18922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:27.201694 18922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:27.201735 18922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:27.211792 18922 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:37855
I20260811 07:27:27.211818 19064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:37855 every 8 connection(s)
I20260811 07:27:27.212800 18922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:27.215461 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 18922
I20260811 07:27:27.215612 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:27.215961 12256 external_mini_cluster.cc:1428] Setting key 8502053f93e2397b4eb00fcfeda793d1
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:27.227640 18604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:27.214871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:47993 (local address 127.11.248.62:35635)
0811 07:27:27.215040 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.215044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.215939 (+ 895us) server_negotiation.cc:407] Connection header received
0811 07:27:27.217697 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.217701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.217760 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.217851 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.219293 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.219831 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.220997 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.221216 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.221297 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:27.223872 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:27.223875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:27.223877 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:27.223911 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:27.225623 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.226162 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.226165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.226166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.226246 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.226566 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.226568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.226569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.226751 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:27.226827 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:27.227370 (+ 543us) server_negotiation.cc:299] Negotiation successful
0811 07:27:27.227509 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:27:27.228506 19067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:27.215225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35635 (local address 127.11.248.3:47993)
0811 07:27:27.215714 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:27.215770 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:27.217410 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:27.218070 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:27.218079 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:27.218615 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:27.219154 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:27.219168 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.219946 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.219949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:27.220880 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:27.220889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.221363 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.221366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:27.221531 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:27.222111 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:27.222126 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:27.223671 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:27.225733 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:27.225738 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:27.225752 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:27.226068 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:27.226328 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:27.226330 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:27.226332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:27.226483 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:27.226883 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:27.226889 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:27.227138 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 07:27:27.227308 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 07:27:27.227583 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":142,"threads_started":1}
I20260811 07:27:27.229929 19065 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35635
I20260811 07:27:27.230221 19065 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:27.230841 19065 heartbeater.cc:511] Master 127.11.248.62:35635 requested a full tablet report, sending...
I20260811 07:27:27.231911 18560 ts_manager.cc:194] Registered new tserver with Master: 410a4556fa3744aa9393607869bd7489 (127.11.248.3:37855)
I20260811 07:27:27.232471 18560 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:47993
I20260811 07:27:27.243225 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/test-admin.keytab.
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.262934 12256 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 07:27:27.266158 12256 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc' of type FILE
W20260811 07:27:27.266201 19074 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:27.264446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36398 (local address 127.11.248.1:42171)
0811 07:27:27.264883 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.264912 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.264965 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:27:27.265020 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.265026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.265223 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.265356 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.266025 (+ 669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36398: BlockingRecv error: recv got EOF from 127.0.0.1:36398 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":102,"threads_started":1}
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.267313 12256 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.268258 12256 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:27:27.279762 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:27.269329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36408 (local address 127.11.248.1:42171)
0811 07:27:27.269473 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.269479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.269644 (+ 165us) server_negotiation.cc:407] Connection header received
0811 07:27:27.269823 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.269827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.269880 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.269971 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.270499 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.271438 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.272280 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.272697 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.272859 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:27.275315 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:27.275327 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:27.275342 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:27.275369 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:27.277585 (+ 2216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.278244 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.278251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.278254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.278356 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.278623 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.278625 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.278627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.278980 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:27.279193 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:27.279346 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 07:27:27.279564 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 07:27:27.284256 19074 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:27.283103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36412 (local address 127.11.248.1:42171)
0811 07:27:27.283246 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.283249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.283365 (+ 116us) server_negotiation.cc:407] Connection header received
0811 07:27:27.283552 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.283555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.283601 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.283697 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.284137 (+ 440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36412: BlockingRecv error: recv got EOF from 127.0.0.1:36412 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 07:27:27.284458 12256 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.285768 12256 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.286806 12256 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:27:27.296026 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:27.287774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36422 (local address 127.11.248.1:42171)
0811 07:27:27.287892 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.287895 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.288048 (+ 153us) server_negotiation.cc:407] Connection header received
0811 07:27:27.288158 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.288161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.288198 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.288270 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.288896 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.289424 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.290280 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.290498 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.290575 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:27.293135 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:27.293138 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:27.293140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:27.293163 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:27.294475 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.294910 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.294912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.294914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.294985 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.295213 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.295215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.295216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.295376 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:27.295486 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:27.295681 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 07:27:27.295781 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 07:27:27.299292 19074 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:27.297979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36426 (local address 127.11.248.1:42171)
0811 07:27:27.298126 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.298131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.298264 (+ 133us) server_negotiation.cc:407] Connection header received
0811 07:27:27.298418 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.298421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.298466 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.298555 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.299160 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36426: BlockingRecv error: recv got EOF from 127.0.0.1:36426 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 07:27:27.299436 12256 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433213255187-12256-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.300630 12256 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:27.301908 12256 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[18507](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:27:27.313043 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:27.302982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36438 (local address 127.11.248.1:42171)
0811 07:27:27.303142 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:27.303149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:27.303199 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:27:27.303362 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:27.303366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:27.303416 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:27.303514 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:27.304152 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.304696 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.305635 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:27.305886 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:27.306008 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:27.309547 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:27.309551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:27.309570 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:27.309604 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:27.311198 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.311648 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.311651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.311652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.311731 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:27.312061 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:27.312063 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:27.312064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:27.312257 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:27.312367 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:27.312644 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 07:27:27.312800 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:27:27.314579 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18630
I20260811 07:27:27.322959 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18775
I20260811 07:27:27.330711 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18922
I20260811 07:27:27.342483 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 18526
2026-08-11T07:27:27Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2364 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[19087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[19087](info): set up 2 sockets
Aug 11 07:27:27 dist-test-slave-77v9 krb5kdc[19087](info): commencing operation
krb5kdc: starting...
W20260811 07:27:28.467957 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:28 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab.
Entry for principal oryx/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab.
I20260811 07:27:28.608289 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36723
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab
--principal=oryx/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:28.729549 19102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:28.729920 19102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:28.730001 19102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:28.734261 19102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:28.734370 19102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:28.734408 19102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:28.734449 19102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:28.734480 19102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:28.740098 19102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab
--principal=oryx/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:28.741379 19102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:28.742466 19102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:28.751467 19110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:28.751497 19108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:28.751552 19107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:28.751490 19102 server_base.cc:1034] running on GCE node
I20260811 07:27:28.752435 19102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:28.753800 19102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:28.755035 19102 hybrid_clock.cc:648] HybridClock initialized: now 1786433248755010 us; error 53 us; skew 500 ppm
Aug 11 07:27:28 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:28.758517 19102 init.cc:377] Logged in from keytab as oryx/127.11.248.62@KRBTEST.COM (short username oryx)
I20260811 07:27:28.759564 19102 webserver.cc:460] Webserver started at http://127.11.248.62:43235/ using document root <none> and password file <none>
I20260811 07:27:28.760155 19102 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:28.760223 19102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:28.760421 19102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:28.762782 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "c31f3133893548b189affce91a28e502"
format_stamp: "Formatted at 2026-08-11 07:27:28 on dist-test-slave-77v9"
server_key: "f97010c7add0dd0b84e519c3e9a60f5f"
server_key_iv: "b05a533788440c6831b332c2c281b1a1"
server_key_version: "encryptionkey@0"
I20260811 07:27:28.763379 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "c31f3133893548b189affce91a28e502"
format_stamp: "Formatted at 2026-08-11 07:27:28 on dist-test-slave-77v9"
server_key: "f97010c7add0dd0b84e519c3e9a60f5f"
server_key_iv: "b05a533788440c6831b332c2c281b1a1"
server_key_version: "encryptionkey@0"
I20260811 07:27:28.767534 19102 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 07:27:28.770236 19117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:28.771550 19102 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:28.771708 19102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "c31f3133893548b189affce91a28e502"
format_stamp: "Formatted at 2026-08-11 07:27:28 on dist-test-slave-77v9"
server_key: "f97010c7add0dd0b84e519c3e9a60f5f"
server_key_iv: "b05a533788440c6831b332c2c281b1a1"
server_key_version: "encryptionkey@0"
I20260811 07:27:28.771828 19102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:28.797606 19102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:28.801141 19102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:28.801379 19102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:28.809029 19102 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:36723
I20260811 07:27:28.809370 19176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:36723 every 8 connection(s)
I20260811 07:27:28.810127 19102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:28.813237 19177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:28.817184 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19102
I20260811 07:27:28.817307 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:28.817642 12256 external_mini_cluster.cc:1428] Setting key d35a3aed87faf721aecf33e9c38c2575
I20260811 07:27:28.820051 19177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Bootstrap starting.
I20260811 07:27:28.823221 19177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:28.824242 19177 log.cc:824] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:28.826910 19177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: No bootstrap required, opened a new log
Aug 11 07:27:28 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:28.831918 19177 raft_consensus.cc:348] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } }
I20260811 07:27:28.832274 19177 raft_consensus.cc:374] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:28.832332 19177 raft_consensus.cc:729] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c31f3133893548b189affce91a28e502, State: Initialized, Role: FOLLOWER
I20260811 07:27:28.832940 19177 consensus_queue.cc:260] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } }
I20260811 07:27:28.833158 19177 raft_consensus.cc:388] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:28.833240 19177 raft_consensus.cc:482] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:28.833354 19177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:28.834728 19177 raft_consensus.cc:504] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } }
I20260811 07:27:28.835178 19177 leader_election.cc:302] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c31f3133893548b189affce91a28e502; no voters:
I20260811 07:27:28.835579 19177 leader_election.cc:288] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:28.835726 19182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:28.836045 19182 raft_consensus.cc:686] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 LEADER]: Becoming Leader. State: Replica: c31f3133893548b189affce91a28e502, State: Running, Role: LEADER
I20260811 07:27:28.836467 19182 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } }
I20260811 07:27:28.836788 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:28.819237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.11.248.62:36723)
0811 07:27:28.819729 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:28.819767 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:28.819815 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:27:28.820780 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:28.820806 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:28.821298 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:28.821736 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:28.822577 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:28.824281 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:28.825482 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:28.826267 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:28.826475 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:28.829993 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:28.830001 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:28.830021 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:28.830063 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:28.832954 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:28.833581 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:28.833591 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:28.833600 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:28.833760 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:28.834102 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:28.834105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:28.834107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:28.834751 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:28.834974 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:28.835318 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 07:27:28.835690 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":117,"threads_started":1}
I20260811 07:27:28.837112 19177 sys_catalog.cc:564] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:28.838306 19185 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } }
I20260811 07:27:28.838434 19185 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:28.838845 19192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:28.839859 19183 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31f3133893548b189affce91a28e502. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } }
I20260811 07:27:28.839969 19183 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:28.842805 19192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:28.849006 19192 catalog_manager.cc:1347] Generated new cluster ID: dfd87b1e819444f2a7994cdfeb7c7fa0
I20260811 07:27:28.849109 19192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:28.875846 19192 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:28.877214 19192 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:28.887058 19192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Generated new TSK 0
I20260811 07:27:28.887938 19192 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab.
Entry for principal oryx/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab.
I20260811 07:27:28.929760 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36723
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:29.075021 19205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:29.075421 19205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:29.075515 19205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:29.079952 19205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:29.080031 19205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:29.080139 19205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:29.085867 19205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:29.087076 19205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:29.088168 19205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:29.098806 19212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.098810 19213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.098806 19215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:29.099128 19205 server_base.cc:1034] running on GCE node
I20260811 07:27:29.099723 19205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:29.100455 19205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:29.101657 19205 hybrid_clock.cc:648] HybridClock initialized: now 1786433249101641 us; error 28 us; skew 500 ppm
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:29.105021 19205 init.cc:377] Logged in from keytab as oryx/127.11.248.1@KRBTEST.COM (short username oryx)
I20260811 07:27:29.106068 19205 webserver.cc:460] Webserver started at http://127.11.248.1:41543/ using document root <none> and password file <none>
I20260811 07:27:29.106732 19205 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:29.106837 19205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:29.107079 19205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:29.109385 19205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "a692028ce98d454b9697619eaeaecfc6"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "b255a99d6e4e9b320fd75b301d24d0d2"
server_key_iv: "f86ab552b7bb2eb1f8a8841b764b01c8"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.110049 19205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "a692028ce98d454b9697619eaeaecfc6"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "b255a99d6e4e9b320fd75b301d24d0d2"
server_key_iv: "f86ab552b7bb2eb1f8a8841b764b01c8"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.114197 19205 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:29.116998 19223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.118257 19205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:29.118414 19205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "a692028ce98d454b9697619eaeaecfc6"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "b255a99d6e4e9b320fd75b301d24d0d2"
server_key_iv: "f86ab552b7bb2eb1f8a8841b764b01c8"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.118546 19205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:29.129801 19205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:29.133962 19205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:29.134256 19205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:29.135026 19205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:29.136075 19205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:29.136168 19205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.136265 19205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:29.136320 19205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.147972 19205 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:46757
I20260811 07:27:29.148010 19347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:46757 every 8 connection(s)
I20260811 07:27:29.149184 19205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:29.149829 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19205
I20260811 07:27:29.149991 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:29.150346 12256 external_mini_cluster.cc:1428] Setting key 987f83b74464b11825fd711a370efaf8
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.2@KRBTEST.COM" created.
I20260811 07:27:29.165791 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.151591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:46467 (local address 127.11.248.62:36723)
0811 07:27:29.151727 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.151730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.152997 (+ 1267us) server_negotiation.cc:407] Connection header received
0811 07:27:29.155051 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.155054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.155113 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.155221 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.156493 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.157171 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.158398 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.158635 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.158748 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.161561 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.161564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.161566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.161591 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.163205 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.163724 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.163727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.163728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.163843 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.164332 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.164336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.164338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.164619 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.164736 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.165366 (+ 630us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.165532 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:27:29.166672 19350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.152183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:46467)
0811 07:27:29.152779 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.152885 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.154830 (+ 1945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.155420 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.155427 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.155813 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.156334 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.156349 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.157324 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.157327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.158249 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.158259 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.158795 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.158799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.158989 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.159687 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.159704 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.161380 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.163339 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.163344 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.163358 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.163628 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.164014 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.164017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.164020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.164229 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.164757 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.164763 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.165115 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.165302 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.165585 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":136,"threads_started":1}
I20260811 07:27:29.168109 19348 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36723
I20260811 07:27:29.168378 19348 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:29.169032 19348 heartbeater.cc:511] Master 127.11.248.62:36723 requested a full tablet report, sending...
I20260811 07:27:29.170923 19135 ts_manager.cc:194] Registered new tserver with Master: a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757)
I20260811 07:27:29.172119 19135 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:46467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab.
Entry for principal oryx/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab.
I20260811 07:27:29.184579 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36723
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:29.298866 19353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:29.299201 19353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:29.299278 19353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:29.303501 19353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:29.303618 19353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:29.303719 19353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:29.309404 19353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:29.310642 19353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:29.311738 19353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:29.323274 19360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.323283 19363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.323293 19359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:29.323587 19353 server_base.cc:1034] running on GCE node
I20260811 07:27:29.324154 19353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:29.325027 19353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:29.326261 19353 hybrid_clock.cc:648] HybridClock initialized: now 1786433249326234 us; error 38 us; skew 500 ppm
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:29.329361 19353 init.cc:377] Logged in from keytab as oryx/127.11.248.2@KRBTEST.COM (short username oryx)
I20260811 07:27:29.330399 19353 webserver.cc:460] Webserver started at http://127.11.248.2:37155/ using document root <none> and password file <none>
I20260811 07:27:29.330999 19353 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:29.331097 19353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:29.331353 19353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:29.333583 19353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "4f271ffa5d374510817edc221c97368d"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6fb74d9c3713934ce7e8eb0e84f04fe5"
server_key_iv: "b9bebb4876885e80c3f9504786ab7a3e"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.334193 19353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "4f271ffa5d374510817edc221c97368d"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6fb74d9c3713934ce7e8eb0e84f04fe5"
server_key_iv: "b9bebb4876885e80c3f9504786ab7a3e"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.338979 19353 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:29.341616 19370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.343022 19353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:29.343173 19353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "4f271ffa5d374510817edc221c97368d"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6fb74d9c3713934ce7e8eb0e84f04fe5"
server_key_iv: "b9bebb4876885e80c3f9504786ab7a3e"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.343312 19353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:29.357308 19353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:29.360961 19353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:29.361186 19353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:29.361838 19353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:29.362727 19353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:29.362807 19353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.362912 19353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:29.362965 19353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.372503 19353 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:44571
I20260811 07:27:29.372517 19504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:44571 every 8 connection(s)
I20260811 07:27:29.373492 19353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:29.382836 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19353
I20260811 07:27:29.383019 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:29.383337 12256 external_mini_cluster.cc:1428] Setting key 459d67b61d39b966cdc2c124aeda65cf
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:29.388559 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.375324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:59931 (local address 127.11.248.62:36723)
0811 07:27:29.375463 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.375467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.376458 (+ 991us) server_negotiation.cc:407] Connection header received
0811 07:27:29.378066 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.378070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.378130 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.378243 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.379425 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.379971 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.381177 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.381425 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.381545 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.384334 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.384338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.384340 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.384364 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.386256 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.386834 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.386840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.386846 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.386931 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.387361 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.387365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.387367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.387557 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.387670 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.388247 (+ 577us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.388381 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:27:29.389642 19507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.375756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:59931)
0811 07:27:29.376271 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.376348 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.377846 (+ 1498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.378429 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.378435 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.378797 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.379267 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.379279 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.380100 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.380103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.381051 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.381061 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.381587 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.381591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.381768 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.382412 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.382429 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.384150 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.386414 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.386419 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.386432 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.386710 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.387030 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.387034 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.387036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.387252 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.387670 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.387679 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.388001 (+ 322us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.388202 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.388578 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":116,"threads_started":1}
I20260811 07:27:29.390877 19505 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36723
I20260811 07:27:29.391201 19505 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:29.391861 19505 heartbeater.cc:511] Master 127.11.248.62:36723 requested a full tablet report, sending...
I20260811 07:27:29.393270 19135 ts_manager.cc:194] Registered new tserver with Master: 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571)
I20260811 07:27:29.394145 19135 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:59931
WARNING: no policy specified for oryx/127.11.248.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab.
Entry for principal oryx/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab.
I20260811 07:27:29.416252 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36723
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:29.537848 19510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:29.538277 19510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:29.538372 19510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:29.542659 19510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:29.542762 19510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:29.542865 19510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:29.548935 19510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:29.550107 19510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:29.551174 19510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:29.561251 19515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.561300 19518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.561250 19516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:29.561580 19510 server_base.cc:1034] running on GCE node
I20260811 07:27:29.562067 19510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:29.562749 19510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:29.563987 19510 hybrid_clock.cc:648] HybridClock initialized: now 1786433249563952 us; error 45 us; skew 500 ppm
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:29.567183 19510 init.cc:377] Logged in from keytab as oryx/127.11.248.3@KRBTEST.COM (short username oryx)
I20260811 07:27:29.568212 19510 webserver.cc:460] Webserver started at http://127.11.248.3:44615/ using document root <none> and password file <none>
I20260811 07:27:29.568785 19510 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:29.568925 19510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:29.569131 19510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:29.571316 19510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "447bb3b9dbc64b86a7207e7759463ee1"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6baa6ad09f4a90282a67a9df3be417fc"
server_key_iv: "bcbbe554789b18d6b5d26c732b33a517"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.571877 19510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "447bb3b9dbc64b86a7207e7759463ee1"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6baa6ad09f4a90282a67a9df3be417fc"
server_key_iv: "bcbbe554789b18d6b5d26c732b33a517"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.576086 19510 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260811 07:27:29.578747 19527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.580174 19510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:29.580348 19510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "447bb3b9dbc64b86a7207e7759463ee1"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6baa6ad09f4a90282a67a9df3be417fc"
server_key_iv: "bcbbe554789b18d6b5d26c732b33a517"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.580487 19510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:29.606703 19510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:29.610368 19510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:29.610610 19510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:29.611259 19510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:29.612152 19510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:29.612226 19510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.612293 19510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:29.612346 19510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.622191 19510 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39811
I20260811 07:27:29.622215 19645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39811 every 8 connection(s)
I20260811 07:27:29.623237 19510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:29.625334 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19510
I20260811 07:27:29.625509 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:29.625824 12256 external_mini_cluster.cc:1428] Setting key 418040fab560ba02004d83f511ce3dd6
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:29.638198 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.625279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:51611 (local address 127.11.248.62:36723)
0811 07:27:29.625446 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.625451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.626447 (+ 996us) server_negotiation.cc:407] Connection header received
0811 07:27:29.628111 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.628114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.628162 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.628236 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.629640 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.630269 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.631427 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.631667 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.631761 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.634462 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.634465 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.634467 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.634493 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.635899 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.636476 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.636479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.636480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.636569 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.637035 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.637038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.637039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.637298 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.637380 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.637950 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.638065 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:27:29.639330 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.625741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:51611)
0811 07:27:29.626284 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.626329 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.627906 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.628372 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.628378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.628855 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.629482 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.629496 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.630384 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.630386 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.631294 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.631302 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.631817 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.631820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.631994 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.632596 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.632613 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.634264 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.636050 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.636056 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.636070 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.636371 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.636692 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.636694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.636696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.636943 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.637402 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.637408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.637672 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.637892 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.638197 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":148,"threads_started":1}
I20260811 07:27:29.640535 19646 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36723
I20260811 07:27:29.640803 19646 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:29.641386 19646 heartbeater.cc:511] Master 127.11.248.62:36723 requested a full tablet report, sending...
I20260811 07:27:29.642529 19134 ts_manager.cc:194] Registered new tserver with Master: 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811)
I20260811 07:27:29.643158 19134 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:51611
I20260811 07:27:29.652674 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.248.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.61.keytab.
Entry for principal oryx/127.11.248.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.61.keytab.
I20260811 07:27:29.684510 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:32985
--webserver_interface=127.11.248.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.61.keytab
--principal=oryx/127.11.248.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36723,127.11.248.61:32985
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:29.801276 19652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:29.801654 19652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:29.801740 19652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:29.805886 19652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:29.806006 19652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:29.806043 19652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:29.806082 19652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:29.806114 19652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:29.811803 19652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36723,127.11.248.61:32985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.61.keytab
--principal=oryx/127.11.248.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:32985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.248.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
W20260811 07:27:29.812088 19652 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.248.62:36723,127.11.248.61:32985'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 07:27:29.813004 19652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:29.814051 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:29.823740 19657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.823892 19661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:29.823740 19658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:29.824069 19652 server_base.cc:1034] running on GCE node
I20260811 07:27:29.824637 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:29.825915 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:29.827162 19652 hybrid_clock.cc:648] HybridClock initialized: now 1786433249827132 us; error 45 us; skew 500 ppm
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:29.830462 19652 init.cc:377] Logged in from keytab as oryx/127.11.248.61@KRBTEST.COM (short username oryx)
I20260811 07:27:29.831672 19652 webserver.cc:460] Webserver started at http://127.11.248.61:46063/ using document root <none> and password file <none>
I20260811 07:27:29.832306 19652 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:29.832408 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:29.832698 19652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:29.835033 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/instance:
uuid: "00cb63df36da41e9b37dc36e2be1bba5"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "788b56abdb8c4a445d140e52b37f3d8f"
server_key_iv: "cae5f71bc2f8c387a6569c4058ac938c"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.835657 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal/instance:
uuid: "00cb63df36da41e9b37dc36e2be1bba5"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "788b56abdb8c4a445d140e52b37f3d8f"
server_key_iv: "cae5f71bc2f8c387a6569c4058ac938c"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.839888 19652 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:27:29.842502 19670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.843828 19652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:29.843961 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
uuid: "00cb63df36da41e9b37dc36e2be1bba5"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "788b56abdb8c4a445d140e52b37f3d8f"
server_key_iv: "cae5f71bc2f8c387a6569c4058ac938c"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.844082 19652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:29.857023 19652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:29.860472 19652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:29.860648 19652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:29.868294 19652 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.61:32985
I20260811 07:27:29.868614 19728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.61:32985 every 8 connection(s)
I20260811 07:27:29.869392 19652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
I20260811 07:27:29.872249 19730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:29.872532 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19652
I20260811 07:27:29.877594 19730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.61@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:29.890161 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.874305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42202 (local address 127.11.248.61:32985)
0811 07:27:29.874758 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.874776 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.874816 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:27:29.875719 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.875740 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.876158 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.876507 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.877516 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.878750 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.879845 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.880471 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.880654 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.883982 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.883988 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.883998 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.884027 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.886288 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.886758 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.886767 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.886777 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.887073 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.887562 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.887567 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.887569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.888185 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.888422 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.888682 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.889029 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":153,"threads_started":1}
I20260811 07:27:29.890962 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.879564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.11.248.62:36723)
0811 07:27:29.879725 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.879729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.880125 (+ 396us) server_negotiation.cc:407] Connection header received
0811 07:27:29.880298 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.880303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.880353 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.880449 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.881315 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.882201 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.883525 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.883805 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.883920 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.886883 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.886886 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.886888 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.886917 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.888656 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.889253 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.889256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.889258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.889354 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.889629 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.889632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.889634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.889920 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.890025 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.890636 (+ 611us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.890818 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:27:29.890969 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.879472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:50588)
0811 07:27:29.880000 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.880044 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.880187 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.880502 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.880508 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.880957 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.881157 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.881166 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.882349 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.882352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.883346 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.883358 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.883983 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.883988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.884086 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.884881 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.884894 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.886729 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.888790 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.888800 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.888833 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.889148 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.889450 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.889452 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.889454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.889532 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.890056 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.890061 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.890162 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.890342 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.890551 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":121,"threads_started":1}
I20260811 07:27:29.892490 19730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433249, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.61@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
I20260811 07:27:29.901268 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.893101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42206)
0811 07:27:29.893214 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.893347 (+ 133us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.893431 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.893676 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.893679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.893845 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.894360 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.894367 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.895154 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.895157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.895662 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.895670 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.896124 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.896127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.896216 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.896670 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.896681 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.898004 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.899703 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.899706 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.899707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.899910 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.900161 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.900163 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.900164 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.900240 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.900728 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.900730 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.900865 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.900992 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.901116 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 07:27:29.901304 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.893211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42206 (local address 127.11.248.61:32985)
0811 07:27:29.893413 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.893416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.893430 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:27:29.893542 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.893545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.893588 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.893666 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.894492 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.895034 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.895776 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.896010 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.896128 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.898165 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.898168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.898170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.898191 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.899597 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.900000 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.900003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.900004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.900078 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.900342 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.900345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.900346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.900620 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.900733 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.901039 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.901174 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":139}
I20260811 07:27:29.904641 19730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Bootstrap starting.
I20260811 07:27:29.907636 19730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:29.908716 19730 log.cc:824] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:29.910944 19730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: No bootstrap required, opened a new log
I20260811 07:27:29.914381 19730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } }
I20260811 07:27:29.914651 19730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:29.914744 19730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cb63df36da41e9b37dc36e2be1bba5, State: Initialized, Role: FOLLOWER
I20260811 07:27:29.915278 19730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } }
I20260811 07:27:29.915827 19739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } } }
I20260811 07:27:29.915951 19739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:29.916628 19730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:27:29.921921 19751 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:27:29.922027 19751 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:27:29.924044 19652 master_runner.cc:428] Detected that this master 00cb63df36da41e9b37dc36e2be1bba5 is joining an existing cluster
I20260811 07:27:29.924106 19652 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.248.61:32985
I20260811 07:27:29.935063 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.926486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50592 (local address 127.11.248.62:36723)
0811 07:27:29.926628 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.926634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.926925 (+ 291us) server_negotiation.cc:407] Connection header received
0811 07:27:29.927091 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.927095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.927150 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.927239 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.928003 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.928887 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.929853 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.930224 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.930287 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.931606 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.931612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.931619 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.931646 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.933249 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.933726 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.933730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.933731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.933830 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.934134 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.934138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.934140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.934375 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.934492 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.934756 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.934883 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:27:29.935081 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.926354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:50592)
0811 07:27:29.926835 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.926850 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.926976 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.927364 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.927367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.927681 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.927846 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.927857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.929018 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.929021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.929691 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.929699 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.930462 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.930467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.930559 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.931005 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.931019 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.931465 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.933368 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.933375 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.933377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.933622 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.933913 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.933916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.933918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.934008 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.934477 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.934480 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.934576 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.934695 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.934869 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":1,"spinlock_wait_cycles":2304,"thread_start_us":119,"threads_started":1}
I20260811 07:27:29.935338 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.926830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.11.248.61:32985)
0811 07:27:29.926939 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.926944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.926959 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:29.927100 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.927103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.927139 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.927228 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.927747 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.928255 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.929279 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.929679 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.929795 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.931208 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.931212 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.931216 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.931244 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.933263 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.933836 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.933840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.933841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.933932 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.934240 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.934243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.934245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.934461 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.934557 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.934841 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.934961 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":32}
I20260811 07:27:29.935981 19759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.926386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42218)
0811 07:27:29.926868 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.926882 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.926976 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.927244 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.927247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.927526 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.927632 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.927639 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.928378 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.928382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.929151 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.929159 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.929837 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.929840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.929925 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.930531 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.930547 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.931035 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.933387 (+ 2352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.933389 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.933392 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.933732 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.934051 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.934056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.934059 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.934142 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.934591 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.934594 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.934666 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.935641 (+ 975us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.935803 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"spinlock_wait_cycles":2176,"thread_start_us":115,"threads_started":1}
Aug 11 07:27:29 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.62@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
I20260811 07:27:29.951889 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.940593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42230)
0811 07:27:29.941026 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.941073 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.941245 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.941585 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.941591 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.942000 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.942120 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.942127 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.942879 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.942882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.943838 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.943848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.944329 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.944333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.944456 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.945161 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.945174 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.947197 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.949676 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.949690 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.949698 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.950062 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.950407 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.950410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.950412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.950515 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.951095 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.951103 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.951252 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.951420 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.951659 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":107,"threads_started":1}
I20260811 07:27:29.951900 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.940635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42230 (local address 127.11.248.61:32985)
0811 07:27:29.940771 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.940776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.941156 (+ 380us) server_negotiation.cc:407] Connection header received
0811 07:27:29.941391 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.941394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.941452 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.941544 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.942241 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.942757 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.943976 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.944212 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.944324 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.947392 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.947397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.947400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.947431 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.949527 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.950184 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.950191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.950195 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.950298 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.950620 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.950623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.950625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.950965 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.951090 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.951508 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.951666 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:27:29.954101 19134 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.248.61:32985: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5"
member_type: NON_VOTER
last_known_addr {
host: "127.11.248.61"
port: 32985
}
attrs {
promote: true
}
}
dest_uuid: "c31f3133893548b189affce91a28e502"
cas_config_opid_index: -1
WARNING: no policy specified for oryx/127.11.248.60@KRBTEST.COM; defaulting to no policy
I20260811 07:27:29.954865 19134 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } }
I20260811 07:27:29.957120 19766 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } }
I20260811 07:27:29.958117 19701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.60@KRBTEST.COM" created.
I20260811 07:27:29.958959 19766 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.248.61:32985
I20260811 07:27:29.959439 19764 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } }
I20260811 07:27:29.959548 19764 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:29.959969 19701 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Refusing update from remote peer c31f3133893548b189affce91a28e502: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 07:27:29.960798 19764 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:29.961658 19652 master.cc:537] Master@127.11.248.61:32985 shutting down...
W20260811 07:27:29.962853 19120 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 07:27:29.964020 19120 consensus_peers.cc:487] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 -> Peer 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61:32985): Couldn't send request to peer 00cb63df36da41e9b37dc36e2be1bba5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:27:29.966735 19652 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:29.967093 19652 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:29.967226 19652 tablet_replica.cc:330] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: stopping tablet replica
I20260811 07:27:29.973245 19652 master.cc:552] Master@127.11.248.61:32985 shutdown complete.
I20260811 07:27:29.973316 19652 master_runner.cc:305] Clearing existing system tablet
I20260811 07:27:29.973680 19652 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:29.973745 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:29.975663 19652 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 07:27:29.976856 19772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:29.977082 19652 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:29.977205 19652 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:29.977247 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
uuid: "00cb63df36da41e9b37dc36e2be1bba5"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "788b56abdb8c4a445d140e52b37f3d8f"
server_key_iv: "cae5f71bc2f8c387a6569c4058ac938c"
server_key_version: "encryptionkey@0"
I20260811 07:27:29.979671 19652 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:29.982992 19652 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:27:29.983115 19652 log.cc:1196] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 07:27:29.984011 19652 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Deleting consensus metadata
I20260811 07:27:29.984215 19652 master_runner.cc:315] Copying system tablet from 127.11.248.62:36723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.60.keytab.
Entry for principal oryx/127.11.248.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.60.keytab.
I20260811 07:27:29.985646 19652 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: tablet copy: Beginning tablet copy session from remote peer at address 127.11.248.62:36723
I20260811 07:27:29.986155 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:44791
--webserver_interface=127.11.248.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.60.keytab
--principal=oryx/127.11.248.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:27:29.997474 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.986424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.11.248.62:36723)
0811 07:27:29.986616 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:29.986624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:29.987233 (+ 609us) server_negotiation.cc:407] Connection header received
0811 07:27:29.987375 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:29.987381 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:29.987461 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:29.987567 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:29.988185 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.989081 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.990848 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.991287 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.991402 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.993348 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:29.993352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:29.993355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:29.993388 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:29.995327 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.995909 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.995912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.995914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.996014 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:29.996364 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:29.996367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:29.996369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:29.996619 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:29.996727 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:29.997162 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 07:27:29.997298 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:27:29.997592 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:29.986762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:50598)
0811 07:27:29.987092 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:29.987109 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:29.987261 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:29.987610 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:29.987613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:29.987859 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:29.988000 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.988008 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.989224 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.989230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.990667 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:29.990683 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:29.991638 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:29.991644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:29.991783 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:29.992507 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:29.992528 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:29.993136 (+ 608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:29.995465 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.995472 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.995477 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.995789 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.996127 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:29.996133 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:29.996136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:29.996253 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:29.996743 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:29.996749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:29.996957 (+ 208us) client_negotiation.cc:769] Sending connection context
0811 07:27:29.997097 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 07:27:29.997295 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":119,"threads_started":1}
I20260811 07:27:29.998518 19159 tablet_copy_service.cc:140] P c31f3133893548b189affce91a28e502: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 00cb63df36da41e9b37dc36e2be1bba5 ({username='oryx', principal='oryx/127.11.248.61@KRBTEST.COM'} at 127.0.0.1:50598)
I20260811 07:27:29.998725 19159 tablet_copy_service.cc:161] P c31f3133893548b189affce91a28e502: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 00cb63df36da41e9b37dc36e2be1bba5 at {username='oryx', principal='oryx/127.11.248.61@KRBTEST.COM'} at 127.0.0.1:50598: session id = 00cb63df36da41e9b37dc36e2be1bba5-00000000000000000000000000000000
I20260811 07:27:30.000658 19159 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:27:30.002741 19652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:27:30.005484 19652 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: tablet copy: Starting download of 0 data blocks...
I20260811 07:27:30.005726 19652 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: tablet copy: Starting download of 1 WAL segments...
I20260811 07:27:30.007992 19652 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:27:30.010573 19159 tablet_copy_service.cc:342] P c31f3133893548b189affce91a28e502: Request end of tablet copy session 00cb63df36da41e9b37dc36e2be1bba5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.248.61@KRBTEST.COM'} at 127.0.0.1:50598
I20260811 07:27:30.010778 19159 tablet_copy_service.cc:433] P c31f3133893548b189affce91a28e502: ending tablet copy session 00cb63df36da41e9b37dc36e2be1bba5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 00cb63df36da41e9b37dc36e2be1bba5
I20260811 07:27:30.019402 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:30.021497 19781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.022151 19785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.022586 19652 server_base.cc:1034] running on GCE node
W20260811 07:27:30.029644 19782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.029992 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:30.030367 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:30.031534 19652 hybrid_clock.cc:648] HybridClock initialized: now 1786433250031500 us; error 59 us; skew 500 ppm
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:30.033491 19652 init.cc:377] Logged in from keytab as oryx/127.11.248.61@KRBTEST.COM (short username oryx)
I20260811 07:27:30.034109 19652 webserver.cc:460] Webserver started at http://127.11.248.61:41029/ using document root <none> and password file <none>
I20260811 07:27:30.034333 19652 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.034382 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.036001 19652 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:30.037411 19792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.037726 19652 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:30.037814 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
uuid: "00cb63df36da41e9b37dc36e2be1bba5"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "788b56abdb8c4a445d140e52b37f3d8f"
server_key_iv: "cae5f71bc2f8c387a6569c4058ac938c"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.037916 19652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:30.048880 19652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:30.051312 19652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:30.056910 19652 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.61:32985
I20260811 07:27:30.057075 19850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.61:32985 every 8 connection(s)
I20260811 07:27:30.057597 19652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
I20260811 07:27:30.059495 19851 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:27:30.060627 19851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Bootstrap starting.
I20260811 07:27:30.072505 19851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:27:30.072964 19851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: Bootstrap complete.
I20260811 07:27:30.073668 19851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } }
I20260811 07:27:30.073836 19851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 00cb63df36da41e9b37dc36e2be1bba5, State: Initialized, Role: LEARNER
I20260811 07:27:30.073954 19851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } }
I20260811 07:27:30.074378 19854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } }
I20260811 07:27:30.074515 19851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:30.074640 19854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:27:30.079277 19867 catalog_manager.cc:1259] Loaded cluster ID: dfd87b1e819444f2a7994cdfeb7c7fa0
I20260811 07:27:30.079360 19867 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: loading cluster ID for follower catalog manager: success
I20260811 07:27:30.081609 19867 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: acquiring CA information for follower catalog manager: success
I20260811 07:27:30.083156 19867 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 07:27:30.130618 19780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:30.131070 19780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:30.131156 19780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:30.138629 19780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:30.138746 19780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:30.138784 19780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:30.138813 19780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:30.138850 19780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:30.148429 19780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.60.keytab
--principal=oryx/127.11.248.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:44791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.248.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:30.149791 19780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:30.151099 19780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:30.162710 19875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.162735 19872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.162710 19873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.163229 19780 server_base.cc:1034] running on GCE node
I20260811 07:27:30.163918 19780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:30.165309 19780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:30.166497 19780 hybrid_clock.cc:648] HybridClock initialized: now 1786433250166474 us; error 43 us; skew 500 ppm
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:30.170181 19780 init.cc:377] Logged in from keytab as oryx/127.11.248.60@KRBTEST.COM (short username oryx)
I20260811 07:27:30.171227 19780 webserver.cc:460] Webserver started at http://127.11.248.60:39855/ using document root <none> and password file <none>
I20260811 07:27:30.171823 19780 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.171924 19780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.172160 19780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:30.174494 19780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/instance:
uuid: "e7b61d71e1de4490994109811ff49597"
format_stamp: "Formatted at 2026-08-11 07:27:30 on dist-test-slave-77v9"
server_key: "6ae15e37b7f762d10f001bad8560df19"
server_key_iv: "512d6eb5be32b03bc2a1a1b519235cd8"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.175087 19348 heartbeater.cc:503] Master 127.11.248.62:36723 was elected leader, sending a full tablet report...
I20260811 07:27:30.175338 19780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal/instance:
uuid: "e7b61d71e1de4490994109811ff49597"
format_stamp: "Formatted at 2026-08-11 07:27:30 on dist-test-slave-77v9"
server_key: "6ae15e37b7f762d10f001bad8560df19"
server_key_iv: "512d6eb5be32b03bc2a1a1b519235cd8"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.180729 19780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:27:30.183929 19883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.185667 19780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:27:30.185802 19780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
uuid: "e7b61d71e1de4490994109811ff49597"
format_stamp: "Formatted at 2026-08-11 07:27:30 on dist-test-slave-77v9"
server_key: "6ae15e37b7f762d10f001bad8560df19"
server_key_iv: "512d6eb5be32b03bc2a1a1b519235cd8"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.185964 19780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:30.201606 19780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:30.205502 19780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:30.205717 19780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:30.214563 19780 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.60:44791
I20260811 07:27:30.214893 19943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.60:44791 every 8 connection(s)
I20260811 07:27:30.215875 19780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
I20260811 07:27:30.216269 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19780
I20260811 07:27:30.219655 19944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:30.224982 19944 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.248.60@KRBTEST.COM
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.60@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:30.235118 19947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.218108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45286 (local address 127.11.248.60:44791)
0811 07:27:30.218596 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.218618 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.218666 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:27:30.219622 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.219651 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.220117 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.220543 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.221436 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.223131 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.224334 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.225173 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.225369 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.229005 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.229012 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.229022 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.229054 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.231303 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.231877 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.231883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.231888 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.232032 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.232420 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.232424 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.232426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.233030 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.233217 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.233663 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.234013 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":131,"threads_started":1}
I20260811 07:27:30.239707 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.227376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50608 (local address 127.11.248.62:36723)
0811 07:27:30.227536 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.227541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.227789 (+ 248us) server_negotiation.cc:407] Connection header received
0811 07:27:30.227943 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.227948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.228017 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.228122 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.229179 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.230124 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.231217 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.231568 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.231657 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.234764 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.234768 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.234771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.234805 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.237438 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.238123 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.238127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.238129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.238225 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.238580 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.238584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.238586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.238883 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.239011 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.239368 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.239513 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:27:30.239728 19948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.227188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:50608)
0811 07:27:30.227632 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.227691 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.227827 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.228223 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.228227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.228722 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.229015 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.229022 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.230269 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.230276 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.231069 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.231080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.231704 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.231709 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.231933 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.232571 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.232584 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.234598 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.237602 (+ 3004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.237612 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.237619 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.238002 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.238354 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.238358 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.238360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.238481 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.239007 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.239013 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.239147 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.239302 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.239520 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":159,"threads_started":1}
I20260811 07:27:30.241191 19944 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.60@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
I20260811 07:27:30.250721 19948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.241696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42236)
0811 07:27:30.241876 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.241892 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.241983 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.242450 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.242452 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.242605 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.242712 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.242717 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.243652 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.243655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.244281 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.244289 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.244730 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.244733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.244888 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.245434 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.245447 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.246942 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.249141 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.249144 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.249145 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.249363 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.249711 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.249713 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.249715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.249801 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.250251 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.250253 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.250365 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.250459 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.250587 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 07:27:30.250785 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.241886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42236 (local address 127.11.248.61:32985)
0811 07:27:30.242211 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.242215 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.242228 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:27:30.242266 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.242268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.242311 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.242392 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.242874 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.243547 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.244393 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.244620 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.244702 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.247097 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.247100 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.247102 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.247164 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.249029 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.249519 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.249523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.249524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.249613 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.249919 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.249922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.249923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.250135 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.250229 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.250527 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.250645 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":137,"threads_started":1}
I20260811 07:27:30.251957 19944 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.60@KRBTEST.COM for oryx/127.11.248.60@KRBTEST.COM
I20260811 07:27:30.261703 19948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.252500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.0.0.1:45292)
0811 07:27:30.252631 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.252647 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.252733 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.253064 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.253066 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.253243 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.253329 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.253334 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.254727 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.254729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.255367 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.255387 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.255898 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.255900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.255966 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.256509 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.256521 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.258071 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.259992 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.259995 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.259998 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.260211 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.260524 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.260527 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.260529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.260617 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.261104 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.261108 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.261209 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.261322 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.261498 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 07:27:30.261703 19947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.252596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.11.248.60:44791)
0811 07:27:30.252724 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.252728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.252741 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:27:30.252796 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.252798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.252893 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.253008 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.253469 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.254587 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.255495 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.255748 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.255832 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.258229 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.258233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.258235 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.258257 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.259840 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.260317 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.260323 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.260325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.260419 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.260709 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.260716 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.260718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.260995 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.261105 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.261380 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.261577 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":73,"server-negotiator.queue_time_us":52}
I20260811 07:27:30.265154 19944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Bootstrap starting.
I20260811 07:27:30.267627 19944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:30.268551 19944 log.cc:824] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:30.271029 19944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: No bootstrap required, opened a new log
I20260811 07:27:30.275628 19944 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } }
I20260811 07:27:30.275956 19944 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:30.276048 19944 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b61d71e1de4490994109811ff49597, State: Initialized, Role: FOLLOWER
I20260811 07:27:30.276597 19944 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } }
I20260811 07:27:30.277252 19951 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } } }
I20260811 07:27:30.277383 19951 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:30.278123 19944 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:27:30.283944 19962 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:27:30.284052 19962 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:27:30.288738 19780 master_runner.cc:428] Detected that this master e7b61d71e1de4490994109811ff49597 is joining an existing cluster
I20260811 07:27:30.288933 19780 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.248.60:44791
I20260811 07:27:30.289125 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19205
I20260811 07:27:30.308444 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:46757
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:36723
--webserver_port=41543
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:27:30.334609 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.300616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.11.248.61:32985)
0811 07:27:30.300893 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.300899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.301994 (+ 1095us) server_negotiation.cc:407] Connection header received
0811 07:27:30.302171 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.302177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.302239 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.302300 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.303413 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.304132 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.305654 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.306127 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.306223 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.330123 (+ 23900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.330129 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.330132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.330169 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.332277 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.332911 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.332916 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.332917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.333018 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.333397 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.333401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.333403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.333674 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.333762 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.334250 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.334404 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:27:30.335405 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.294337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42248)
0811 07:27:30.301900 (+ 7563us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.301916 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.302062 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.302485 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.302491 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.302780 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.303265 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.303276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.304285 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.304292 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.305501 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.305516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.306397 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.306403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.306566 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.307127 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.307150 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.329851 (+ 22701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.332432 (+ 2581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.332436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.332438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.332732 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.333144 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.333148 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.333151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.333285 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.333922 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.333926 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.334038 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.334868 (+ 830us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.335045 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7475,"mutex_wait_us":1,"spinlock_wait_cycles":3968,"thread_start_us":296,"threads_started":1}
I20260811 07:27:30.338909 19947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.301164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.11.248.60:44791)
0811 07:27:30.301324 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.301331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.301349 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:27:30.301403 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.301409 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.301468 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.301564 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.302313 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.303188 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.304597 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.305100 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.305191 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.332963 (+ 27772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.332968 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.332971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.333002 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.334923 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.337413 (+ 2490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.337417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.337419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.337510 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.337801 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.337804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.337806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.338049 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.338130 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.338576 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.338731 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":114,"server-negotiator.queue_time_us":63}
I20260811 07:27:30.339847 19971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.293547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.0.0.1:45308)
0811 07:27:30.294919 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.294939 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.295099 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.301599 (+ 6500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.301603 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.302042 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.302175 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.302183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.303323 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.303326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.304462 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.304473 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.305820 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.305824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.305953 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.306640 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.306658 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.329831 (+ 23173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.335386 (+ 5555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.335389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.335392 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.336622 (+ 1230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.337610 (+ 988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.337613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.337616 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.337708 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.338243 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.338246 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.338368 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.338500 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.339650 (+ 1150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1221,"thread_start_us":284,"threads_started":1}
I20260811 07:27:30.344990 19970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.293587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:50622)
0811 07:27:30.301175 (+ 7588us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.301193 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.301463 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.306268 (+ 4805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.306272 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.330008 (+ 23736us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.330182 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.330189 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.332217 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.332220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.337240 (+ 5020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.337252 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.339274 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.339278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.339423 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.340084 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.340100 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.340581 (+ 481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.343058 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.343062 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.343064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.343361 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.343720 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.343724 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.343726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.343826 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.344323 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.344326 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.344458 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.344568 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.344738 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7458,"thread_start_us":231,"threads_started":1}
I20260811 07:27:30.344993 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.293538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50622 (local address 127.11.248.62:36723)
0811 07:27:30.293721 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.293728 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.301319 (+ 7591us) server_negotiation.cc:407] Connection header received
0811 07:27:30.305564 (+ 4245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.305569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.305627 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.305692 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.330369 (+ 24677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.332011 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.337400 (+ 5389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.337947 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.338099 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.340790 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.340928 (+ 138us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.340933 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.340974 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.342914 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.343496 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.343500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.343502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.343606 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.343960 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.343963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.343965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.344208 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.344313 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.344664 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.344839 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433248, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.62@KRBTEST.COM for oryx/127.11.248.60@KRBTEST.COM
I20260811 07:27:30.360097 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.349682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.0.0.1:45322)
0811 07:27:30.349806 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.349824 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.349917 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.350426 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.350430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.350665 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.350802 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.350809 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.351861 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.351865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.352892 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.352904 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.353477 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.353481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.353608 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.354194 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.354210 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.355936 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.358223 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.358227 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.358229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.358532 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.358867 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.358870 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.358873 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.358973 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.359480 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.359483 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.359592 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.359699 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.359891 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 07:27:30.361194 19947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.350012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.11.248.60:44791)
0811 07:27:30.350149 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.350153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.350167 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:27:30.350234 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.350237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.350290 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.350374 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.350936 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.351710 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.353021 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.353342 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.353454 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.356119 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.356123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.356127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.356159 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.358067 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.358657 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.358661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.358664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.358757 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.359083 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.359087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.359089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.359321 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.359430 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.360729 (+ 1299us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.361027 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:30.362540 19134 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.248.60:44791: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e7b61d71e1de4490994109811ff49597"
member_type: NON_VOTER
last_known_addr {
host: "127.11.248.60"
port: 44791
}
attrs {
promote: true
}
}
dest_uuid: "c31f3133893548b189affce91a28e502"
cas_config_opid_index: 5
I20260811 07:27:30.363227 19134 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } }
I20260811 07:27:30.364861 19764 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e7b61d71e1de4490994109811ff49597 (127.11.248.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.366585 19764 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.248.60:44791
I20260811 07:27:30.366797 19764 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.366907 19764 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:30.367867 19780 master.cc:537] Master@127.11.248.60:44791 shutting down...
I20260811 07:27:30.368083 19918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:30.370148 19918 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Refusing update from remote peer c31f3133893548b189affce91a28e502: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:27:30.371125 19766 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:30.372184 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.365971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42254 (local address 127.11.248.61:32985)
0811 07:27:30.366099 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.366105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.366122 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:27:30.366178 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.366181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.366246 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.366359 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:30.366932 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.367717 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.369837 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.370529 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.370648 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.370937 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.371959 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.372055 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:27:30.372907 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.365092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42254)
0811 07:27:30.365381 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.365396 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.365481 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.366606 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.366610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.366631 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:30.366730 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.366736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.368072 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.368079 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.369641 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.369658 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.371104 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.371108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.371205 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.371377 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.371462 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.372734 (+ 1272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206}
I20260811 07:27:30.373725 19822 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 LEARNER]: Refusing update from remote peer c31f3133893548b189affce91a28e502: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:27:30.376179 19766 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 07:27:30.378433 19822 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e7b61d71e1de4490994109811ff49597 (127.11.248.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.381070 19854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31f3133893548b189affce91a28e502. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.381188 19854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:27:30.381282 19854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: NON_VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: true } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.381345 19854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: LEARNER
W20260811 07:27:30.382207 19118 consensus_peers.cc:487] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 -> Peer e7b61d71e1de4490994109811ff49597 (127.11.248.60:44791): Couldn't send request to peer e7b61d71e1de4490994109811ff49597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:27:30.382687 19780 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:30.382997 19780 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:30.383111 19780 tablet_replica.cc:330] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: stopping tablet replica
I20260811 07:27:30.383337 19766 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: attempting to promote NON_VOTER 00cb63df36da41e9b37dc36e2be1bba5 to VOTER
I20260811 07:27:30.383837 19766 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } }
I20260811 07:27:30.385524 19821 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 LEARNER]: Refusing update from remote peer c31f3133893548b189affce91a28e502: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 07:27:30.386111 19764 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 07:27:30.388079 19118 consensus_peers.cc:487] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 -> Peer e7b61d71e1de4490994109811ff49597 (127.11.248.60:44791): Couldn't send request to peer e7b61d71e1de4490994109811ff49597. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:27:30.389040 19764 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.390890 19764 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.391000 19764 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:30.391237 19780 master.cc:552] Master@127.11.248.60:44791 shutdown complete.
I20260811 07:27:30.391302 19780 master_runner.cc:305] Clearing existing system tablet
I20260811 07:27:30.391822 19780 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.391808 19766 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.391896 19780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.391912 19766 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:30.392881 19821 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.393404 19780 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:30.394313 19980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.394516 19780 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:30.394629 19780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:30.394585 19975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.394665 19780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
uuid: "e7b61d71e1de4490994109811ff49597"
format_stamp: "Formatted at 2026-08-11 07:27:30 on dist-test-slave-77v9"
server_key: "6ae15e37b7f762d10f001bad8560df19"
server_key_iv: "512d6eb5be32b03bc2a1a1b519235cd8"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.394714 19975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:30.396656 19505 heartbeater.cc:503] Master 127.11.248.62:36723 was elected leader, sending a full tablet report...
I20260811 07:27:30.397054 19780 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:30.399767 19780 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:27:30.399886 19780 log.cc:1196] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 07:27:30.400182 19780 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Deleting consensus metadata
I20260811 07:27:30.400388 19780 master_runner.cc:315] Copying system tablet from 127.11.248.62:36723
I20260811 07:27:30.401826 19780 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: tablet copy: Beginning tablet copy session from remote peer at address 127.11.248.62:36723
I20260811 07:27:30.412508 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.402546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50628 (local address 127.11.248.62:36723)
0811 07:27:30.402687 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.402692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.402892 (+ 200us) server_negotiation.cc:407] Connection header received
0811 07:27:30.403030 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.403033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.403091 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.403179 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.403782 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.404696 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.405959 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.406353 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.406494 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.408446 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.408451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.408454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.408486 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.410436 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.410955 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.410960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.410962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.411067 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.411409 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.411412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.411415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.411666 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.411779 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.412167 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.412311 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:30.412537 19986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.402434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:50628)
0811 07:27:30.402778 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.402795 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.402918 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.403216 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.403219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.403490 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.403644 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.403652 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.404905 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.404909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.405828 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.405840 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.406509 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.406516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.406614 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.407756 (+ 1142us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.407771 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.408264 (+ 493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.410569 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.410573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.410575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.410839 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.411177 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.411181 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.411184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.411294 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.411777 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.411780 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.411891 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.412063 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.412295 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":104,"threads_started":1}
I20260811 07:27:30.413371 19159 tablet_copy_service.cc:140] P c31f3133893548b189affce91a28e502: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e7b61d71e1de4490994109811ff49597 ({username='oryx', principal='oryx/127.11.248.60@KRBTEST.COM'} at 127.0.0.1:50628)
I20260811 07:27:30.413489 19159 tablet_copy_service.cc:161] P c31f3133893548b189affce91a28e502: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e7b61d71e1de4490994109811ff49597 at {username='oryx', principal='oryx/127.11.248.60@KRBTEST.COM'} at 127.0.0.1:50628: session id = e7b61d71e1de4490994109811ff49597-00000000000000000000000000000000
I20260811 07:27:30.414691 19159 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:27:30.416170 19780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:27:30.418989 19780 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: tablet copy: Starting download of 0 data blocks...
I20260811 07:27:30.419256 19780 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: tablet copy: Starting download of 1 WAL segments...
I20260811 07:27:30.421062 19780 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:27:30.423535 19159 tablet_copy_service.cc:342] P c31f3133893548b189affce91a28e502: Request end of tablet copy session e7b61d71e1de4490994109811ff49597-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.248.60@KRBTEST.COM'} at 127.0.0.1:50628
I20260811 07:27:30.423651 19159 tablet_copy_service.cc:433] P c31f3133893548b189affce91a28e502: ending tablet copy session e7b61d71e1de4490994109811ff49597-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e7b61d71e1de4490994109811ff49597
I20260811 07:27:30.433413 19780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:30.435623 19988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.435828 19990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.435719 19987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.436175 19780 server_base.cc:1034] running on GCE node
I20260811 07:27:30.436437 19780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:30.436901 19780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:30.438174 19780 hybrid_clock.cc:648] HybridClock initialized: now 1786433250438160 us; error 34 us; skew 500 ppm
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:30.440349 19780 init.cc:377] Logged in from keytab as oryx/127.11.248.60@KRBTEST.COM (short username oryx)
I20260811 07:27:30.440959 19780 webserver.cc:460] Webserver started at http://127.11.248.60:40437/ using document root <none> and password file <none>
I20260811 07:27:30.441176 19780 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.441227 19780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.445381 19780 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:27:30.446774 19999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.447115 19780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:30.447263 19780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
uuid: "e7b61d71e1de4490994109811ff49597"
format_stamp: "Formatted at 2026-08-11 07:27:30 on dist-test-slave-77v9"
server_key: "6ae15e37b7f762d10f001bad8560df19"
server_key_iv: "512d6eb5be32b03bc2a1a1b519235cd8"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.447510 19780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 07:27:30.464407 19972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:30.464772 19972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:30.464895 19972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:30.470502 19972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:30.470674 19972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:30.470810 19972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:30.477983 19972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:46757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=41543
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:30.479354 19972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:30.480551 19972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:27:30.483889 19780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:30.486438 19780 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260811 07:27:30.493549 20019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.493677 20017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.493575 20016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.494220 19780 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.60:44791
I20260811 07:27:30.494338 20071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.60:44791 every 8 connection(s)
I20260811 07:27:30.494575 19972 server_base.cc:1034] running on GCE node
I20260811 07:27:30.494992 19780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
I20260811 07:27:30.495127 19972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:30.496142 19972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:30.497386 19972 hybrid_clock.cc:648] HybridClock initialized: now 1786433250497363 us; error 55 us; skew 500 ppm
I20260811 07:27:30.497489 20072 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:27:30.498507 20072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Bootstrap starting.
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:30.502660 19972 init.cc:377] Logged in from keytab as oryx/127.11.248.1@KRBTEST.COM (short username oryx)
I20260811 07:27:30.503834 19972 webserver.cc:460] Webserver started at http://127.11.248.1:41543/ using document root <none> and password file <none>
I20260811 07:27:30.504474 19972 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.504554 19972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.509084 19972 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:27:30.511366 20080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.512879 19972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:30.513027 19972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "a692028ce98d454b9697619eaeaecfc6"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "b255a99d6e4e9b320fd75b301d24d0d2"
server_key_iv: "f86ab552b7bb2eb1f8a8841b764b01c8"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.513649 19972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:30.515654 20072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:27:30.515991 20072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Bootstrap complete.
I20260811 07:27:30.516582 20072 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } }
I20260811 07:27:30.516876 20072 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e7b61d71e1de4490994109811ff49597, State: Initialized, Role: LEARNER
I20260811 07:27:30.517096 20072 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } }
I20260811 07:27:30.517590 20072 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:30.517795 20081 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.518056 20081 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:27:30.522312 20098 catalog_manager.cc:1259] Loaded cluster ID: dfd87b1e819444f2a7994cdfeb7c7fa0
I20260811 07:27:30.522380 20098 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: loading cluster ID for follower catalog manager: success
I20260811 07:27:30.524497 20098 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: acquiring CA information for follower catalog manager: success
I20260811 07:27:30.525863 20098 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:27:30.535549 19972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:30.539845 19972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:30.540117 19972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:30.540973 19972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:30.542011 19972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:30.542078 19972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.542150 19972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:30.542181 19972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.560750 19972 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:46757
I20260811 07:27:30.560863 20214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:46757 every 8 connection(s)
I20260811 07:27:30.562065 19972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:30.564977 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 19972
I20260811 07:27:30.565260 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19353
I20260811 07:27:30.580734 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:44571
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:36723
--webserver_port=37155
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.60@KRBTEST.COM
I20260811 07:27:30.595191 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.564385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:58151 (local address 127.11.248.61:32985)
0811 07:27:30.564527 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.564532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.575251 (+ 10719us) server_negotiation.cc:407] Connection header received
0811 07:27:30.577318 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.577322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.577380 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.577442 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.579937 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.580899 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583197 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.583589 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583678 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.589000 (+ 5322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.589022 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.589029 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.589071 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.591684 (+ 2613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.592797 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.592803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.592831 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.592942 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593499 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.593504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.593506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.593815 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.593905 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.594855 (+ 950us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.594998 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:27:30.595191 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.564734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:60565 (local address 127.11.248.62:36723)
0811 07:27:30.566383 (+ 1649us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.566391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.575428 (+ 9037us) server_negotiation.cc:407] Connection header received
0811 07:27:30.577308 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.577313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.577380 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.577442 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.579937 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.580907 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583197 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.583587 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583677 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.590452 (+ 6775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.590460 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.590465 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.590509 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.592895 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593503 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.593507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.593509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.593606 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593957 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.593961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.593965 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.594225 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.594321 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.594842 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.594998 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1506}
I20260811 07:27:30.595283 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.564397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:56113 (local address 127.11.248.60:44791)
0811 07:27:30.565072 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.565093 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.576275 (+ 11182us) server_negotiation.cc:407] Connection header received
0811 07:27:30.577140 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.577147 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.577251 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.577333 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.579925 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.581046 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583165 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.583606 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583704 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.589876 (+ 6172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.589884 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.589889 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.589930 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.591982 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.592780 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.592786 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.592788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.592922 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593500 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.593506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.593510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.593802 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.593878 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.594847 (+ 969us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.595027 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":110,"threads_started":1}
I20260811 07:27:30.597440 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.564793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:60565)
0811 07:27:30.575275 (+ 10482us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.575291 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.577127 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.577865 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.577877 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.578736 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.579724 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.579744 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.581406 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.581409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.583027 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.583037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.583936 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.584353 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.585589 (+ 1236us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.585610 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.589185 (+ 3575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.593045 (+ 3860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593050 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.593055 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.593362 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.593737 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593741 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.593744 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.593834 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.594402 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.594405 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.594498 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.595491 (+ 993us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.596020 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10349,"mutex_wait_us":756,"spinlock_wait_cycles":108160,"thread_start_us":398,"threads_started":1}
I20260811 07:27:30.597441 20220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.564898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.11.248.1:56113)
0811 07:27:30.576120 (+ 11222us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.576136 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.576849 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.577867 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.577879 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.578709 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.579716 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.579745 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.581206 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.581211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.582993 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.583007 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.583937 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.584309 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.585364 (+ 1055us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.585391 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.589655 (+ 4264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.592151 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.592157 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.592162 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.592633 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.593055 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593061 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.593065 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.593366 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.593976 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.593987 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.594501 (+ 514us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.595536 (+ 1035us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.596146 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11149,"mutex_wait_us":742,"spinlock_wait_cycles":73472,"thread_start_us":9099,"threads_started":1}
I20260811 07:27:30.598387 20221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.564793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.11.248.1:58151)
0811 07:27:30.574938 (+ 10145us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.575053 (+ 115us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.576799 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.577865 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.577877 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.578719 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.579723 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.579744 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.581161 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.581166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.583025 (+ 1859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.583037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.583936 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.583940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.584285 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.585423 (+ 1138us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.585442 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.588650 (+ 3208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.592027 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.592038 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.592071 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.592629 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.593071 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.593073 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.593075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.593362 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.593984 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.593987 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.594497 (+ 510us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.596037 (+ 1540us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.596222 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9699,"mutex_wait_us":688,"spinlock_wait_cycles":71040,"thread_start_us":538,"threads_started":1}
I20260811 07:27:30.599022 20216 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36723
I20260811 07:27:30.599308 20216 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:30.599870 20216 heartbeater.cc:511] Master 127.11.248.62:36723 requested a full tablet report, sending...
I20260811 07:27:30.599059 20215 heartbeater.cc:347] Connected to a master server at 127.11.248.60:44791
I20260811 07:27:30.600626 20215 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:30.600791 20217 heartbeater.cc:347] Connected to a master server at 127.11.248.61:32985
I20260811 07:27:30.600896 20215 heartbeater.cc:511] Master 127.11.248.60:44791 requested a full tablet report, sending...
I20260811 07:27:30.600940 20217 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:30.601127 20217 heartbeater.cc:511] Master 127.11.248.61:32985 requested a full tablet report, sending...
I20260811 07:27:30.601347 19134 ts_manager.cc:194] Re-registered known tserver with Master: a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757)
I20260811 07:27:30.602155 19134 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:60565
I20260811 07:27:30.602231 19811 ts_manager.cc:194] Registered new tserver with Master: a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757)
I20260811 07:27:30.603084 20030 ts_manager.cc:194] Registered new tserver with Master: a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757)
I20260811 07:27:30.645340 19646 heartbeater.cc:503] Master 127.11.248.62:36723 was elected leader, sending a full tablet report...
W20260811 07:27:30.712450 20223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:30.712738 20223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:30.712790 20223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:30.716922 20223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:30.717039 20223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:30.717141 20223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:30.722823 20223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:44571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=37155
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:30.723915 20223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:30.724954 20223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:30.735167 20232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.735201 20230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.735189 20229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.735455 20223 server_base.cc:1034] running on GCE node
I20260811 07:27:30.735980 20223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:30.736690 20223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:30.737871 20223 hybrid_clock.cc:648] HybridClock initialized: now 1786433250737832 us; error 58 us; skew 500 ppm
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:30.741293 20223 init.cc:377] Logged in from keytab as oryx/127.11.248.2@KRBTEST.COM (short username oryx)
I20260811 07:27:30.742352 20223 webserver.cc:460] Webserver started at http://127.11.248.2:37155/ using document root <none> and password file <none>
I20260811 07:27:30.743193 20223 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.743364 20223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.748725 20223 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:30.751109 20240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.752458 20223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:27:30.752627 20223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "4f271ffa5d374510817edc221c97368d"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6fb74d9c3713934ce7e8eb0e84f04fe5"
server_key_iv: "b9bebb4876885e80c3f9504786ab7a3e"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.753377 20223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:30.775802 20223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:30.779510 20223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:30.779754 20223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:30.780416 20223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:30.781445 20223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:30.781520 20223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.781594 20223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:30.781638 20223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.792328 20223 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:44571
I20260811 07:27:30.792512 20365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:44571 every 8 connection(s)
I20260811 07:27:30.793669 20223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:30.801167 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 20223
I20260811 07:27:30.801384 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19510
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
I20260811 07:27:30.810514 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.795743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:35977 (local address 127.11.248.61:32985)
0811 07:27:30.796038 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.796044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.798058 (+ 2014us) server_negotiation.cc:407] Connection header received
0811 07:27:30.798568 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.798572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.798622 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.798681 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.800323 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.800954 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.802564 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.802807 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.802929 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.806027 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.806031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.806033 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.806066 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.807698 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.808446 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.808450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.808452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.808532 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.809197 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.809201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.809202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.809454 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.809527 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.810213 (+ 686us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.810356 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260811 07:27:30.812263 20371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.796403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.11.248.2:35977)
0811 07:27:30.797895 (+ 1492us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.797909 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.798296 (+ 387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.798916 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.798919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.799495 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.800155 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.800170 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.801176 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.801178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.802432 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.802442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.802973 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.802977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.803222 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.803918 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.803934 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.805836 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.807859 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.807867 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.807884 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.808318 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.808628 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.808632 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.808634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.808794 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.809610 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.809617 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.809940 (+ 323us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.810757 (+ 817us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.811127 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1369,"mutex_wait_us":211,"spinlock_wait_cycles":32000,"thread_start_us":244,"threads_started":1}
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.60@KRBTEST.COM
I20260811 07:27:30.821843 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.795822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:49937 (local address 127.11.248.62:36723)
0811 07:27:30.795964 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.795968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.797144 (+ 1176us) server_negotiation.cc:407] Connection header received
0811 07:27:30.798537 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.798541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.798604 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.798696 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.800966 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.801764 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.814069 (+ 12305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.814451 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.814569 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.817681 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.817685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.817688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.817720 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.819826 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.820416 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.820419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.820421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.820505 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.820784 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.820787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.820789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.821037 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.821114 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.821524 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.821678 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:27:30.822499 20370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.796403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:49937)
0811 07:27:30.796988 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.797041 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.798269 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.798903 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.798909 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.799492 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.800168 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.800177 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.812398 (+ 12221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.812404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.813892 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.813909 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.814720 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.814724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.814886 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.815621 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.815635 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.817502 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.820029 (+ 2527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.820033 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.820035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.820302 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.820608 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.820611 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.820613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.820692 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.821172 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.821174 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.821276 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.822082 (+ 806us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.822254 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":66,"spinlock_wait_cycles":49408,"thread_start_us":183,"threads_started":1}
I20260811 07:27:30.823941 20367 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36723
I20260811 07:27:30.824241 20367 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:30.825078 20367 heartbeater.cc:511] Master 127.11.248.62:36723 requested a full tablet report, sending...
I20260811 07:27:30.825654 20368 heartbeater.cc:347] Connected to a master server at 127.11.248.61:32985
I20260811 07:27:30.825752 20368 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:30.825903 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.796095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:34599 (local address 127.11.248.60:44791)
0811 07:27:30.796265 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.796270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.797696 (+ 1426us) server_negotiation.cc:407] Connection header received
0811 07:27:30.798834 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.798840 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.798905 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.798987 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:30.809435 (+ 10448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.810606 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.814131 (+ 3525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.814684 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.814805 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.821067 (+ 6262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:30.821077 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:30.821083 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:30.821129 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:30.823518 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.824209 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.824216 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.824221 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.824340 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:30.824775 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:30.824778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:30.824780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:30.825080 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:30.825191 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.825583 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.825750 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:27:30.825947 20368 heartbeater.cc:511] Master 127.11.248.61:32985 requested a full tablet report, sending...
I20260811 07:27:30.826424 19134 ts_manager.cc:194] Re-registered known tserver with Master: 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571)
I20260811 07:27:30.826800 20372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.796404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.11.248.2:34599)
0811 07:27:30.797546 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.797562 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.798269 (+ 707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.799089 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.799094 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.799508 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:30.800170 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.800178 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.810843 (+ 10665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.810850 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.812233 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.812249 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.815243 (+ 2994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.815253 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.815439 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.816196 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:30.816219 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:30.820795 (+ 4576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:30.823692 (+ 2897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.823698 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.823704 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.824057 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.824482 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:30.824488 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:30.824493 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:30.824618 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:30.825297 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:30.825300 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:30.825392 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.826277 (+ 885us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.826441 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"mutex_wait_us":118,"spinlock_wait_cycles":5376,"thread_start_us":273,"threads_started":1}
I20260811 07:27:30.826761 19811 ts_manager.cc:194] Registered new tserver with Master: 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571)
I20260811 07:27:30.827318 19134 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:49937
I20260811 07:27:30.829505 20366 heartbeater.cc:347] Connected to a master server at 127.11.248.60:44791
I20260811 07:27:30.829612 20366 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:30.829840 20366 heartbeater.cc:511] Master 127.11.248.60:44791 requested a full tablet report, sending...
I20260811 07:27:30.830628 20030 ts_manager.cc:194] Registered new tserver with Master: 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571)
I20260811 07:27:30.832588 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:39811
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:36723
--webserver_port=44615
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:27:30.945551 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.941479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.0.0.1:45330)
0811 07:27:30.941742 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:30.941757 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:30.941867 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:30.942197 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:30.942199 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:30.942214 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:30.942316 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.942320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.943381 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.943384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.944187 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:30.944197 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.945194 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.945196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:30.945271 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.945295 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:27:30.945343 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 07:27:30.945420 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260811 07:27:30.945583 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:30.941594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45330 (local address 127.11.248.60:44791)
0811 07:27:30.941745 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:30.941750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:30.941844 (+ 94us) server_negotiation.cc:407] Connection header received
0811 07:27:30.941968 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:30.941972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:30.942043 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:30.942166 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:30.942421 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.943254 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.944326 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:30.945052 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:30.945161 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:30.945327 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:30.945365 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 07:27:30.945440 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:27:30.946502 20041 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 07:27:30.946996 20081 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c31f3133893548b189affce91a28e502. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:30.947160 20081 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: This master's current role is: LEARNER
W20260811 07:27:30.954164 20373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:30.954514 20373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:30.954597 20373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:30.959069 20373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:30.959147 20373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:30.959239 20373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:30.964955 20373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:39811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=44615
--tserver_master_addrs=127.11.248.62:36723,127.11.248.61:32985,127.11.248.60:44791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:30.966135 20373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:30.967303 20373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:30.978559 20382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:30.978559 20381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.978765 20373 server_base.cc:1034] running on GCE node
W20260811 07:27:30.978562 20384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:30.979367 20373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:30.980115 20373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:30.981276 20373 hybrid_clock.cc:648] HybridClock initialized: now 1786433250981264 us; error 27 us; skew 500 ppm
Aug 11 07:27:30 dist-test-slave-77v9 krb5kdc[19087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:30.984244 20373 init.cc:377] Logged in from keytab as oryx/127.11.248.3@KRBTEST.COM (short username oryx)
I20260811 07:27:30.985225 20373 webserver.cc:460] Webserver started at http://127.11.248.3:44615/ using document root <none> and password file <none>
I20260811 07:27:30.985810 20373 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:30.985918 20373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:30.990473 20373 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:27:30.992969 20392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:30.994338 20373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:30.994499 20373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "447bb3b9dbc64b86a7207e7759463ee1"
format_stamp: "Formatted at 2026-08-11 07:27:29 on dist-test-slave-77v9"
server_key: "6baa6ad09f4a90282a67a9df3be417fc"
server_key_iv: "bcbbe554789b18d6b5d26c732b33a517"
server_key_version: "encryptionkey@0"
I20260811 07:27:30.995103 20373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:31.017942 20373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:31.021965 20373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:31.022197 20373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:31.022836 20373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:31.023802 20373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:31.023880 20373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:31.023967 20373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:31.024021 20373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:31.033659 20373 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39811
I20260811 07:27:31.033679 20515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39811 every 8 connection(s)
I20260811 07:27:31.034809 20373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:31.041169 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 20373
Aug 11 07:27:31 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.61@KRBTEST.COM
Aug 11 07:27:31 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
Aug 11 07:27:31 dist-test-slave-77v9 krb5kdc[19087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433250, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.60@KRBTEST.COM
I20260811 07:27:31.057219 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.036905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:49937 (local address 127.11.248.61:32985)
0811 07:27:31.037422 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.037427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.038883 (+ 1456us) server_negotiation.cc:407] Connection header received
0811 07:27:31.039631 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.039637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.039705 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.039792 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.041585 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.042455 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.044733 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.045110 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.045192 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.050625 (+ 5433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.050629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.050632 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.050662 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.053008 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.053704 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.053707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.053709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.053856 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.054280 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.054283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.054285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.054513 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.054613 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.056953 (+ 2340us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.057084 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404}
I20260811 07:27:31.057698 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.037306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.11.248.3:49937)
0811 07:27:31.038785 (+ 1479us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.038800 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.039233 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.039934 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.039937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.040514 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:31.041386 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.041407 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.042651 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.042654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.044571 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.044585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.045380 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.045385 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.045712 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.046976 (+ 1264us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:31.046988 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:31.050418 (+ 3430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:31.053149 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:31.053157 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:31.053177 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:31.053579 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:31.053966 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:31.053969 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:31.053971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:31.054170 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:31.054670 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:31.054680 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:31.055103 (+ 423us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.055359 (+ 256us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.055798 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1400,"mutex_wait_us":885,"spinlock_wait_cycles":78080,"thread_start_us":169,"threads_started":1}
I20260811 07:27:31.059091 20518 heartbeater.cc:347] Connected to a master server at 127.11.248.61:32985
I20260811 07:27:31.059202 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.037250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:33603 (local address 127.11.248.62:36723)
0811 07:27:31.037512 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.037517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.038119 (+ 602us) server_negotiation.cc:407] Connection header received
0811 07:27:31.039489 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.039494 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.039556 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.039669 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.041581 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.042429 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.044703 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.045084 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.045167 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.051643 (+ 6476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.051648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.051652 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.051685 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.054660 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.055976 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.055980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.055982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.056114 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.056483 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.056486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.056488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.056730 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.056848 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.058864 (+ 2016us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.058993 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260811 07:27:31.059340 20518 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:31.059885 20518 heartbeater.cc:511] Master 127.11.248.61:32985 requested a full tablet report, sending...
I20260811 07:27:31.059991 20522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.037306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:33603)
0811 07:27:31.037945 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.038004 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.039228 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.039883 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.039895 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.040517 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:31.041384 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.041408 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.042632 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.042636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.044566 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.044572 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.045379 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.045383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.045747 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.046734 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:31.046770 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:31.051498 (+ 4728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:31.055014 (+ 3516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:31.055017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:31.055019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:31.055535 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:31.056248 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:31.056251 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:31.056253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:31.056351 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:31.056917 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:31.056922 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:31.057039 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.059478 (+ 2439us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.059665 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":537,"spinlock_wait_cycles":1920,"thread_start_us":165,"threads_started":1}
I20260811 07:27:31.060688 20517 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36723
I20260811 07:27:31.060770 20517 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:31.060863 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.037103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:49411 (local address 127.11.248.60:44791)
0811 07:27:31.037639 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.037646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.038647 (+ 1001us) server_negotiation.cc:407] Connection header received
0811 07:27:31.039736 (+ 1089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.039742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.039807 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.039890 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.041581 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.042430 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.044702 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.045084 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.045167 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.051374 (+ 6207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.051378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.051381 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.051443 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.053540 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.054792 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.054795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.054797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.054887 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.057599 (+ 2712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.057602 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.057604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.057864 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.057943 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.060495 (+ 2552us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.060636 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437}
I20260811 07:27:31.060987 20517 heartbeater.cc:511] Master 127.11.248.62:36723 requested a full tablet report, sending...
I20260811 07:27:31.061039 19811 ts_manager.cc:194] Registered new tserver with Master: 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811)
I20260811 07:27:31.061398 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.037306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.11.248.3:49411)
0811 07:27:31.038561 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.038575 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.039214 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.039928 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.039931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.040517 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:31.041415 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.041422 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.042632 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.042636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.044545 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.044559 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.045379 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.045383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.045875 (+ 492us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.046794 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:31.046805 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:31.051207 (+ 4402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:31.054382 (+ 3175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:31.054386 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:31.054388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:31.054641 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:31.057238 (+ 2597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:31.057241 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:31.057243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:31.057481 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:31.058419 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:31.058423 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:31.058528 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.060985 (+ 2457us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.061136 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1097,"mutex_wait_us":689,"spinlock_wait_cycles":26112,"thread_start_us":165,"threads_started":1}
I20260811 07:27:31.061719 19134 ts_manager.cc:194] Re-registered known tserver with Master: 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811)
I20260811 07:27:31.061996 20516 heartbeater.cc:347] Connected to a master server at 127.11.248.60:44791
I20260811 07:27:31.062074 20516 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:31.062234 20516 heartbeater.cc:511] Master 127.11.248.60:44791 requested a full tablet report, sending...
I20260811 07:27:31.062429 19134 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:33603
I20260811 07:27:31.063014 20030 ts_manager.cc:194] Registered new tserver with Master: 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811)
I20260811 07:27:31.067554 20531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.046165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45332 (local address 127.11.248.60:44791)
0811 07:27:31.046645 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.046651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.050095 (+ 3444us) server_negotiation.cc:407] Connection header received
0811 07:27:31.050188 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.050192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.050246 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.050336 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.051345 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.053019 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.054444 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.055125 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.055228 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.058050 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.058053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.058056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.058080 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.064561 (+ 6481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.065208 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.065213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.065215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.065311 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.066003 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.066009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.066010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.066282 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.066418 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.067209 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.067353 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":193,"threads_started":1}
I20260811 07:27:31.069447 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.043597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42262 (local address 127.11.248.61:32985)
0811 07:27:31.045192 (+ 1595us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.045196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.045578 (+ 382us) server_negotiation.cc:407] Connection header received
0811 07:27:31.045619 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.045621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.045673 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.045761 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.050237 (+ 4476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.050987 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.052861 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.053209 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.053323 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.065119 (+ 11796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.065123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.065126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.065154 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.067321 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.067998 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.068002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.068004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.068098 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.068423 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.068427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.068428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.068649 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.068775 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.069131 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.069255 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1515,"thread_start_us":81,"threads_started":1}
I20260811 07:27:31.069696 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.044516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50630 (local address 127.11.248.62:36723)
0811 07:27:31.045631 (+ 1115us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.045635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.047319 (+ 1684us) server_negotiation.cc:407] Connection header received
0811 07:27:31.047372 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.047376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.047438 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.047580 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.048672 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.049659 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.051819 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.054150 (+ 2331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.054267 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.065967 (+ 11700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.065971 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.065974 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.066000 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.067854 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.068368 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.068371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.068373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.068457 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.068738 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.068741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.068742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.068974 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.069070 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.069398 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.069526 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1039,"thread_start_us":80,"threads_started":1}
I20260811 07:27:31.073309 19134 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50630:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:31.077114 19134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:31.079993 20374 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: NON_VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: true } } }
I20260811 07:27:31.080171 20374 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:31.083949 20534 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: attempting to promote NON_VOTER e7b61d71e1de4490994109811ff49597 to VOTER
I20260811 07:27:31.084275 20534 consensus_queue.cc:237] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:31.086071 19821 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Refusing update from remote peer c31f3133893548b189affce91a28e502: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 07:27:31.086475 20374 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 07:27:31.087970 20040 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 LEARNER]: Refusing update from remote peer c31f3133893548b189affce91a28e502: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 07:27:31.088285 20536 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e7b61d71e1de4490994109811ff49597 (127.11.248.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.088490 20374 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 07:27:31.089040 19821 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e7b61d71e1de4490994109811ff49597 (127.11.248.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.090130 20536 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.090221 20536 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:31.090327 20536 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.090394 20536 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:31.090029 20040 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e7b61d71e1de4490994109811ff49597 (127.11.248.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.091249 20545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.091439 20545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:31.091941 20081 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.092059 20081 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:31.092741 20534 sys_catalog.cc:455] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c31f3133893548b189affce91a28e502" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:31.093034 20534 sys_catalog.cc:458] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:31.101604 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.095321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:44571 (local address 127.0.0.1:33874)
0811 07:27:31.095469 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.095491 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.095567 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.096551 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.096554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.096571 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:31.096694 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.096701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.098374 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.098378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.099592 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.099604 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.101039 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.101044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.101170 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.101198 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.101318 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.101447 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":35}
I20260811 07:27:31.101648 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.095493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33874 (local address 127.11.248.2:44571)
0811 07:27:31.095904 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.095921 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.095950 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:27:31.096073 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.096081 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.096358 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.096596 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:31.096797 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.098244 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.099742 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.100899 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.101016 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.101161 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.101347 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.101461 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":121,"threads_started":1}
I20260811 07:27:31.102837 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.096334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:46757 (local address 127.0.0.1:47920)
0811 07:27:31.097377 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.097393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.097509 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.098374 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.098377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.098396 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:31.098513 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.098519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.100180 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.100183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.101362 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.101372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.102444 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.102448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.102535 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.102557 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.102638 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.102711 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"thread_start_us":170,"threads_started":1}
I20260811 07:27:31.102880 20554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.096977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47920 (local address 127.11.248.1:46757)
0811 07:27:31.097762 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.097820 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.097844 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:27:31.097948 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.097954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.098165 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.098366 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:31.098654 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.100052 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.101513 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.102309 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.102441 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.102581 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.102667 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.102757 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":78,"threads_started":1}
I20260811 07:27:31.105438 20292 tablet_service.cc:1467] Processing CreateTablet for tablet d1ce8eac5d4f486898dace10ca7d82fd (DEFAULT_TABLE table=test-table [id=6e059cf2b9984fac9aa1f9f4d25c5a81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:31.105744 20144 tablet_service.cc:1467] Processing CreateTablet for tablet d1ce8eac5d4f486898dace10ca7d82fd (DEFAULT_TABLE table=test-table [id=6e059cf2b9984fac9aa1f9f4d25c5a81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:31.106592 20292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ce8eac5d4f486898dace10ca7d82fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:31.106693 20144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ce8eac5d4f486898dace10ca7d82fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:31.110513 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.095902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39811 (local address 127.0.0.1:57474)
0811 07:27:31.096259 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.096277 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.096376 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.099473 (+ 3097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.099475 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.099492 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:31.099574 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.099578 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.101179 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.101182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.102472 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.102483 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.109948 (+ 7465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.109953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.110101 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.110133 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.110224 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.110317 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":1,"thread_start_us":170,"threads_started":1}
I20260811 07:27:31.110591 20552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.096074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57474 (local address 127.11.248.3:39811)
0811 07:27:31.098755 (+ 2681us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.098784 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.098807 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:27:31.098870 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.098874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.099014 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.099236 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:31.099824 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.101033 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.102622 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.109783 (+ 7161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.109927 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.110120 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.110289 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.110410 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2563,"thread_start_us":147,"threads_started":1}
I20260811 07:27:31.114387 20447 tablet_service.cc:1467] Processing CreateTablet for tablet d1ce8eac5d4f486898dace10ca7d82fd (DEFAULT_TABLE table=test-table [id=6e059cf2b9984fac9aa1f9f4d25c5a81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:31.115651 20447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ce8eac5d4f486898dace10ca7d82fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:31.116232 20557 tablet_bootstrap.cc:492] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Bootstrap starting.
I20260811 07:27:31.117264 20558 tablet_bootstrap.cc:492] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Bootstrap starting.
I20260811 07:27:31.119796 20557 tablet_bootstrap.cc:654] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:31.120697 20558 tablet_bootstrap.cc:654] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:31.121327 20557 log.cc:824] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:31.122159 20558 log.cc:824] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:31.123975 20557 tablet_bootstrap.cc:492] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: No bootstrap required, opened a new log
I20260811 07:27:31.124187 20557 ts_tablet_manager.cc:1397] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:27:31.124375 20558 tablet_bootstrap.cc:492] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: No bootstrap required, opened a new log
I20260811 07:27:31.124588 20558 ts_tablet_manager.cc:1397] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:27:31.125303 20561 tablet_bootstrap.cc:492] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Bootstrap starting.
I20260811 07:27:31.128662 20557 raft_consensus.cc:348] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.128999 20561 tablet_bootstrap.cc:654] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:31.129058 20557 raft_consensus.cc:374] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:31.129114 20557 raft_consensus.cc:729] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a692028ce98d454b9697619eaeaecfc6, State: Initialized, Role: FOLLOWER
I20260811 07:27:31.129602 20557 consensus_queue.cc:260] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.130499 20561 log.cc:824] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:31.130574 20557 ts_tablet_manager.cc:1428] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 07:27:31.130837 20216 heartbeater.cc:503] Master 127.11.248.62:36723 was elected leader, sending a full tablet report...
I20260811 07:27:31.131942 20558 raft_consensus.cc:348] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.132239 20558 raft_consensus.cc:374] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:31.132315 20558 raft_consensus.cc:729] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f271ffa5d374510817edc221c97368d, State: Initialized, Role: FOLLOWER
I20260811 07:27:31.132858 20558 consensus_queue.cc:260] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.134124 20558 ts_tablet_manager.cc:1428] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 07:27:31.134518 20367 heartbeater.cc:503] Master 127.11.248.62:36723 was elected leader, sending a full tablet report...
I20260811 07:27:31.137691 20561 tablet_bootstrap.cc:492] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: No bootstrap required, opened a new log
I20260811 07:27:31.137945 20561 ts_tablet_manager.cc:1397] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.003s
I20260811 07:27:31.143460 20561 raft_consensus.cc:348] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.143738 20561 raft_consensus.cc:374] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:31.143819 20561 raft_consensus.cc:729] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447bb3b9dbc64b86a7207e7759463ee1, State: Initialized, Role: FOLLOWER
I20260811 07:27:31.144419 20561 consensus_queue.cc:260] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.145368 20517 heartbeater.cc:503] Master 127.11.248.62:36723 was elected leader, sending a full tablet report...
I20260811 07:27:31.145743 20561 ts_tablet_manager.cc:1428] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Time spent starting tablet: real 0.008s user 0.005s sys 0.003s
I20260811 07:27:31.165374 20563 raft_consensus.cc:482] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:31.165642 20563 raft_consensus.cc:504] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.166949 20563 leader_election.cc:288] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811), a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757)
I20260811 07:27:31.171115 20552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.167339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:37113 (local address 127.11.248.3:39811)
0811 07:27:31.167500 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.167505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.167717 (+ 212us) server_negotiation.cc:407] Connection header received
0811 07:27:31.167824 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.167826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.167867 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.167952 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:31.168268 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.168794 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.169926 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.170445 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.170550 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.170592 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.170890 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.170974 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:27:31.171159 20370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.167299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39811 (local address 127.11.248.2:37113)
0811 07:27:31.167619 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.167634 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.167731 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.167966 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.167969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.167992 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:31.168151 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.168156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.168951 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.168957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.169772 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.169781 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.170579 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.170583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.170738 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.170765 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.170848 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.170919 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":145}
I20260811 07:27:31.171275 20554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.167438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:52545 (local address 127.11.248.1:46757)
0811 07:27:31.167561 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.167566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.167582 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:31.167646 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.167651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.167714 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.167812 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:31.168345 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.168917 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.170106 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.170604 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.170753 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.170801 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.171041 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.171138 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:27:31.171170 20372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.167287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:46757 (local address 127.11.248.2:52545)
0811 07:27:31.167437 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:31.167454 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:31.167556 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:31.168049 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:31.168051 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:31.168065 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:31.168187 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.168192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.169020 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.169023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.169971 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:31.169981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.170733 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.170736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:31.170887 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.170922 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:27:31.170995 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:27:31.171060 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 07:27:31.172120 20468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ce8eac5d4f486898dace10ca7d82fd" candidate_uuid: "4f271ffa5d374510817edc221c97368d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447bb3b9dbc64b86a7207e7759463ee1" is_pre_election: true
I20260811 07:27:31.172132 20166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ce8eac5d4f486898dace10ca7d82fd" candidate_uuid: "4f271ffa5d374510817edc221c97368d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a692028ce98d454b9697619eaeaecfc6" is_pre_election: true
I20260811 07:27:31.172441 20468 raft_consensus.cc:2454] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f271ffa5d374510817edc221c97368d in term 0.
I20260811 07:27:31.172524 20166 raft_consensus.cc:2454] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f271ffa5d374510817edc221c97368d in term 0.
I20260811 07:27:31.172986 20243 leader_election.cc:302] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447bb3b9dbc64b86a7207e7759463ee1, 4f271ffa5d374510817edc221c97368d; no voters:
I20260811 07:27:31.173303 20563 raft_consensus.cc:2781] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:31.173394 20563 raft_consensus.cc:482] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:31.173440 20563 raft_consensus.cc:3037] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:31.175540 20563 raft_consensus.cc:504] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.175978 20563 leader_election.cc:288] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [CANDIDATE]: Term 1 election: Requested vote from peers 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811), a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757)
I20260811 07:27:31.176327 20166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ce8eac5d4f486898dace10ca7d82fd" candidate_uuid: "4f271ffa5d374510817edc221c97368d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a692028ce98d454b9697619eaeaecfc6"
I20260811 07:27:31.176370 20468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1ce8eac5d4f486898dace10ca7d82fd" candidate_uuid: "4f271ffa5d374510817edc221c97368d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447bb3b9dbc64b86a7207e7759463ee1"
I20260811 07:27:31.176469 20166 raft_consensus.cc:3037] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:31.176561 20468 raft_consensus.cc:3037] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:31.177954 20166 raft_consensus.cc:2454] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f271ffa5d374510817edc221c97368d in term 1.
I20260811 07:27:31.178099 20468 raft_consensus.cc:2454] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f271ffa5d374510817edc221c97368d in term 1.
I20260811 07:27:31.178251 20244 leader_election.cc:302] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f271ffa5d374510817edc221c97368d, a692028ce98d454b9697619eaeaecfc6; no voters:
I20260811 07:27:31.178426 20563 raft_consensus.cc:2781] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:31.178687 20563 raft_consensus.cc:686] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 1 LEADER]: Becoming Leader. State: Replica: 4f271ffa5d374510817edc221c97368d, State: Running, Role: LEADER
I20260811 07:27:31.179127 20563 consensus_queue.cc:237] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:31.182559 19134 catalog_manager.cc:5495] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f271ffa5d374510817edc221c97368d (127.11.248.2). New cstate: current_term: 1 leader_uuid: "4f271ffa5d374510817edc221c97368d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } health_report { overall_health: UNKNOWN } } }
I20260811 07:27:31.202404 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.198292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33884 (local address 127.11.248.2:44571)
0811 07:27:31.198424 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.198428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.198443 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:31.198602 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.198604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.198684 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.198778 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:31.199114 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.199669 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.200656 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.201004 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.201102 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.201481 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:31.201969 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:31.202076 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.202200 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.202283 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:27:31.209322 20468 raft_consensus.cc:1261] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Refusing update from remote peer 4f271ffa5d374510817edc221c97368d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:31.209323 20166 raft_consensus.cc:1261] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 1 FOLLOWER]: Refusing update from remote peer 4f271ffa5d374510817edc221c97368d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:31.210240 20563 consensus_queue.cc:1035] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:31.210485 20566 consensus_queue.cc:1035] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [LEADER]: Connected to new peer: Peer: permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:31.223759 20569 mvcc.cc:205] Tried to move back new op lower bound from 7317230596944928768 to 7317230596832149504. Current Snapshot: MvccSnapshot[applied={T|T < 7317230596944928768 or (T in {7317230596944928768})}]
I20260811 07:27:31.224027 20571 mvcc.cc:205] Tried to move back new op lower bound from 7317230596944928768 to 7317230596832149504. Current Snapshot: MvccSnapshot[applied={T|T < 7317230596944928768}]
I20260811 07:27:31.226414 20570 mvcc.cc:205] Tried to move back new op lower bound from 7317230596944928768 to 7317230596832149504. Current Snapshot: MvccSnapshot[applied={T|T < 7317230596944928768}]
I20260811 07:27:31.233500 19134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50630:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:31.233701 19134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50630:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:31.238473 19134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c31f3133893548b189affce91a28e502: Sending DeleteTablet for 3 replicas of tablet d1ce8eac5d4f486898dace10ca7d82fd
I20260811 07:27:31.239408 20292 tablet_service.cc:1514] Processing DeleteTablet for tablet d1ce8eac5d4f486898dace10ca7d82fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:31 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:33874
I20260811 07:27:31.239836 20144 tablet_service.cc:1514] Processing DeleteTablet for tablet d1ce8eac5d4f486898dace10ca7d82fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:31 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:47920
I20260811 07:27:31.240433 20579 tablet_replica.cc:330] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: stopping tablet replica
I20260811 07:27:31.240892 20579 raft_consensus.cc:2229] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:31.240994 20447 tablet_service.cc:1514] Processing DeleteTablet for tablet d1ce8eac5d4f486898dace10ca7d82fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:31 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:57474
I20260811 07:27:31.241423 20579 raft_consensus.cc:2258] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:31.241881 20578 tablet_replica.cc:330] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: stopping tablet replica
I20260811 07:27:31.242242 20578 raft_consensus.cc:2229] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:31.242681 20578 raft_consensus.cc:2258] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:31.243422 20579 ts_tablet_manager.cc:1905] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:31.244124 20578 ts_tablet_manager.cc:1905] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:31.244422 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19102
I20260811 07:27:31.248667 20578 ts_tablet_manager.cc:1918] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:31.249007 20578 log.cc:1196] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/d1ce8eac5d4f486898dace10ca7d82fd
I20260811 07:27:31.249523 20578 ts_tablet_manager.cc:1939] T d1ce8eac5d4f486898dace10ca7d82fd P 4f271ffa5d374510817edc221c97368d: Deleting consensus metadata
I20260811 07:27:31.250036 20579 ts_tablet_manager.cc:1918] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:31.250164 20579 log.cc:1196] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/d1ce8eac5d4f486898dace10ca7d82fd
I20260811 07:27:31.250702 20579 ts_tablet_manager.cc:1939] T d1ce8eac5d4f486898dace10ca7d82fd P a692028ce98d454b9697619eaeaecfc6: Deleting consensus metadata
I20260811 07:27:31.253696 20580 tablet_replica.cc:330] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: stopping tablet replica
I20260811 07:27:31.254127 20580 raft_consensus.cc:2229] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:31.254534 20580 raft_consensus.cc:2258] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:31.256309 20580 ts_tablet_manager.cc:1905] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:27:31.257642 20089 connection.cc:535] server connection from 127.0.0.1:47920 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 07:27:31.258262 20243 connection.cc:535] server connection from 127.0.0.1:33874 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:27:31.260167 20580 ts_tablet_manager.cc:1918] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:31.260286 20580 log.cc:1196] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/d1ce8eac5d4f486898dace10ca7d82fd
I20260811 07:27:31.260630 20580 ts_tablet_manager.cc:1939] T d1ce8eac5d4f486898dace10ca7d82fd P 447bb3b9dbc64b86a7207e7759463ee1: Deleting consensus metadata
W20260811 07:27:31.261933 20393 connection.cc:441] server connection from 127.0.0.1:57474 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57474 (request call id 1) could send its response
I20260811 07:27:31.264979 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.242770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.11.248.61:32985)
0811 07:27:31.243033 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.243039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.253306 (+ 10267us) server_negotiation.cc:407] Connection header received
0811 07:27:31.253511 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.253517 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.253578 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.253659 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.255103 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.255897 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.257187 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.257657 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.257765 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.260657 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.260663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.260669 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.260699 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.262704 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.263232 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.263236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.263238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.263350 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.263700 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.263703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.263705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.263973 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.264107 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.264544 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.264696 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260811 07:27:31.274797 20219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.263190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45350 (local address 127.11.248.60:44791)
0811 07:27:31.263325 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.263330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.263669 (+ 339us) server_negotiation.cc:407] Connection header received
0811 07:27:31.263879 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.263883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.263934 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.264020 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.265631 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.266368 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.267610 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.267921 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.268021 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.270249 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.270253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.270256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.270284 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.272527 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.273228 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.273232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.273234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.273318 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.273634 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.273637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.273639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.273846 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.273963 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.274319 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.274598 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:27:31.274887 19949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.262539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42286 (local address 127.11.248.61:32985)
0811 07:27:31.262659 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.262663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.263365 (+ 702us) server_negotiation.cc:407] Connection header received
0811 07:27:31.263960 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.263963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.264009 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.264058 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.265045 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.265837 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.268044 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.268401 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.268476 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.270705 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.270709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.270712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.270737 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.272651 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.273356 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.273361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.273363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.273452 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.273758 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.273762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.273766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.274047 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.274164 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.274559 (+ 395us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.274693 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:27:31.275264 20531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:31.242880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.11.248.60:44791)
0811 07:27:31.243151 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:31.243155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:31.265968 (+ 22813us) server_negotiation.cc:407] Connection header received
0811 07:27:31.266126 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:31.266128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:31.266178 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:31.266224 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:31.267175 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.267909 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.269165 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:31.269530 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:31.269632 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:31.271253 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:31.271257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:31.271260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:31.271285 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:31.273356 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.273818 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.273822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.273824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.273915 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:31.274228 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:31.274231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:31.274233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:31.274480 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:31.274578 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:31.274917 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 07:27:31.275052 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"spinlock_wait_cycles":3712}
I20260811 07:27:32.226027 20590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.225498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:36753)
0811 07:27:32.225818 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.225927 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":142,"threads_started":1}
W20260811 07:27:32.226469 20216 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:36723 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.229535 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.228959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:52289)
0811 07:27:32.229306 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.229424 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":109,"threads_started":1}
W20260811 07:27:32.229928 20367 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:36723 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.231438 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.230950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:53499)
0811 07:27:32.231224 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.231335 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":89,"threads_started":1}
W20260811 07:27:32.231757 20517 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:36723 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.739804 20593 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c31f3133893548b189affce91a28e502)
I20260811 07:27:32.740089 20593 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:32.740991 20595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c31f3133893548b189affce91a28e502)
I20260811 07:27:32.741219 20595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:32.741873 20593 leader_election.cc:288] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c31f3133893548b189affce91a28e502 (127.11.248.62:36723), 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61:32985)
I20260811 07:27:32.742416 20596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.741540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51126)
0811 07:27:32.742201 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.742287 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":79,"threads_started":1}
W20260811 07:27:32.742630 20001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.742986 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.742377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51138)
0811 07:27:32.742800 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.742873 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":103,"threads_started":1}
W20260811 07:27:32.743281 19794 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.743479 20595 leader_election.cc:288] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c31f3133893548b189affce91a28e502 (127.11.248.62:36723), e7b61d71e1de4490994109811ff49597 (127.11.248.60:44791)
I20260811 07:27:32.743719 20596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.743464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51150)
0811 07:27:32.743600 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.743655 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260811 07:27:32.743842 20001 leader_election.cc:334] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.744302 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.744009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51160)
0811 07:27:32.744159 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.744213 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 07:27:32.744460 19794 leader_election.cc:334] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.747947 20603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.743308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45358 (local address 127.11.248.60:44791)
0811 07:27:32.743763 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:32.743854 (+ 91us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:32.743871 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:27:32.743975 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:32.743978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:32.744029 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:32.744153 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:32.744503 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.745285 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.746620 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.747248 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.747366 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:32.747448 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:32.747697 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:27:32.747813 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":93,"threads_started":1}
I20260811 07:27:32.747943 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.743017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:44791 (local address 127.0.0.1:45358)
0811 07:27:32.743142 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.743155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:32.743242 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:32.744195 (+ 953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:32.744197 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:32.744227 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:32.744368 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:32.744375 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.745379 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.745385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:32.746480 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:32.746490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.747420 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.747423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:32.747525 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:32.747571 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:27:32.747666 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:27:32.747752 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":28,"spinlock_wait_cycles":3584,"thread_start_us":74,"threads_started":1}
I20260811 07:27:32.748097 20598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.742439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:32985 (local address 127.0.0.1:42288)
0811 07:27:32.742884 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.742899 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:32.743013 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:32.743883 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:32.743887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:32.743919 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:32.744042 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:32.744051 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.745355 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.745359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:32.746678 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:32.746688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.747578 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.747583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:32.747692 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:32.747741 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:27:32.747814 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:27:32.747887 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":54,"threads_started":1}
I20260811 07:27:32.748104 20599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.742624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42288 (local address 127.11.248.61:32985)
0811 07:27:32.743604 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:32.743610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:32.743625 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:32.743688 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:32.743690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:32.743742 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:32.744193 (+ 451us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:32.744325 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.745214 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.746806 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:32.747449 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:32.747569 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:32.747625 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:32.747830 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 07:27:32.747913 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":923,"thread_start_us":66,"threads_started":1}
I20260811 07:27:32.748558 20040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "00cb63df36da41e9b37dc36e2be1bba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e7b61d71e1de4490994109811ff49597" is_pre_election: true
I20260811 07:27:32.748566 19821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7b61d71e1de4490994109811ff49597" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "00cb63df36da41e9b37dc36e2be1bba5" is_pre_election: true
I20260811 07:27:32.748867 19821 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7b61d71e1de4490994109811ff49597 in term 1.
I20260811 07:27:32.748878 20040 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00cb63df36da41e9b37dc36e2be1bba5 in term 1.
I20260811 07:27:32.749310 19793 leader_election.cc:302] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00cb63df36da41e9b37dc36e2be1bba5, e7b61d71e1de4490994109811ff49597; no voters: c31f3133893548b189affce91a28e502
I20260811 07:27:32.749399 20007 leader_election.cc:302] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00cb63df36da41e9b37dc36e2be1bba5, e7b61d71e1de4490994109811ff49597; no voters: c31f3133893548b189affce91a28e502
I20260811 07:27:32.749567 20595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:27:32.749604 20593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:27:32.749662 20593 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c31f3133893548b189affce91a28e502)
I20260811 07:27:32.749672 20595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c31f3133893548b189affce91a28e502)
I20260811 07:27:32.749724 20595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:27:32.749724 20593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:27:32.751093 20595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:32.751093 20593 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:32.751533 20595 leader_election.cc:288] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [CANDIDATE]: Term 2 election: Requested vote from peers c31f3133893548b189affce91a28e502 (127.11.248.62:36723), e7b61d71e1de4490994109811ff49597 (127.11.248.60:44791)
I20260811 07:27:32.751533 20593 leader_election.cc:288] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 2 election: Requested vote from peers c31f3133893548b189affce91a28e502 (127.11.248.62:36723), 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61:32985)
I20260811 07:27:32.752120 20598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.751715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51174)
0811 07:27:32.751955 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.752029 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260811 07:27:32.752141 20040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "00cb63df36da41e9b37dc36e2be1bba5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e7b61d71e1de4490994109811ff49597"
I20260811 07:27:32.752249 19821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7b61d71e1de4490994109811ff49597" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "00cb63df36da41e9b37dc36e2be1bba5"
I20260811 07:27:32.752336 20040 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 00cb63df36da41e9b37dc36e2be1bba5 in current term 2: Already voted for candidate e7b61d71e1de4490994109811ff49597 in this term.
I20260811 07:27:32.752427 19821 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e7b61d71e1de4490994109811ff49597 in current term 2: Already voted for candidate 00cb63df36da41e9b37dc36e2be1bba5 in this term.
I20260811 07:27:32.752897 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.751961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51184)
0811 07:27:32.752729 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.752784 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540}
I20260811 07:27:32.753211 20598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.753012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51196)
0811 07:27:32.753104 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.753150 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 07:27:32.753346 20001 leader_election.cc:334] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.753435 20001 leader_election.cc:302] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7b61d71e1de4490994109811ff49597; no voters: 00cb63df36da41e9b37dc36e2be1bba5, c31f3133893548b189affce91a28e502
I20260811 07:27:32.753579 20593 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 07:27:32.753609 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:32.753358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51200)
0811 07:27:32.753485 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:32.753542 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 07:27:32.753736 19794 leader_election.cc:334] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:32.753883 19794 leader_election.cc:302] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00cb63df36da41e9b37dc36e2be1bba5; no voters: c31f3133893548b189affce91a28e502, e7b61d71e1de4490994109811ff49597
I20260811 07:27:32.754060 20595 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 07:27:33.227888 20605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:33.227255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:35485)
0811 07:27:33.227640 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:33.227723 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":131,"threads_started":1}
I20260811 07:27:33.231231 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:33.230552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:38883)
0811 07:27:33.231027 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:33.231112 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":131,"threads_started":1}
I20260811 07:27:33.232862 20608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:33.232403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:56381)
0811 07:27:33.232669 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:33.232723 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":105,"threads_started":1}
I20260811 07:27:34.229437 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.228977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:54323)
0811 07:27:34.229256 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.229318 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":109,"threads_started":1}
I20260811 07:27:34.232498 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.232055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:39431)
0811 07:27:34.232326 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.232401 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":89,"threads_started":1}
I20260811 07:27:34.233909 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.233539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:50543)
0811 07:27:34.233767 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.233830 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":81,"threads_started":1}
I20260811 07:27:34.630210 20612 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:34.630481 20612 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:34.631114 20612 leader_election.cc:288] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c31f3133893548b189affce91a28e502 (127.11.248.62:36723), 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61:32985)
I20260811 07:27:34.631707 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.631308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51464)
0811 07:27:34.631562 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.631624 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":100,"threads_started":1}
I20260811 07:27:34.631654 19821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7b61d71e1de4490994109811ff49597" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "00cb63df36da41e9b37dc36e2be1bba5" is_pre_election: true
I20260811 07:27:34.631935 19821 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7b61d71e1de4490994109811ff49597 in term 2.
I20260811 07:27:34.632413 20007 leader_election.cc:302] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cb63df36da41e9b37dc36e2be1bba5, e7b61d71e1de4490994109811ff49597; no voters:
I20260811 07:27:34.632622 20612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 07:27:34.632620 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.632338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51476)
0811 07:27:34.632482 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.632550 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 07:27:34.632717 20612 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:34.632766 20612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 2 FOLLOWER]: Advancing to term 3
W20260811 07:27:34.632844 20001 leader_election.cc:334] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:34.633889 20612 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:34.634261 20612 leader_election.cc:288] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 3 election: Requested vote from peers c31f3133893548b189affce91a28e502 (127.11.248.62:36723), 00cb63df36da41e9b37dc36e2be1bba5 (127.11.248.61:32985)
I20260811 07:27:34.634691 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.634453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51482)
0811 07:27:34.634570 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.634629 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 07:27:34.634709 19821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e7b61d71e1de4490994109811ff49597" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "00cb63df36da41e9b37dc36e2be1bba5"
I20260811 07:27:34.634913 19821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:27:34.635422 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.635190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51484)
0811 07:27:34.635315 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.635367 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:27:34.635546 20001 leader_election.cc:334] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
I20260811 07:27:34.636175 19821 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7b61d71e1de4490994109811ff49597 in term 3.
I20260811 07:27:34.636476 20007 leader_election.cc:302] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00cb63df36da41e9b37dc36e2be1bba5, e7b61d71e1de4490994109811ff49597; no voters: c31f3133893548b189affce91a28e502
I20260811 07:27:34.636674 20612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:27:34.636950 20612 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [term 3 LEADER]: Becoming Leader. State: Replica: e7b61d71e1de4490994109811ff49597, State: Running, Role: LEADER
I20260811 07:27:34.637238 20612 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } }
I20260811 07:27:34.638803 20615 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7b61d71e1de4490994109811ff49597. Latest consensus state: current_term: 3 leader_uuid: "e7b61d71e1de4490994109811ff49597" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:34.638936 20615 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:34.639235 20617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:34.641666 20617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:34.642040 20617 catalog_manager.cc:1259] Loaded cluster ID: dfd87b1e819444f2a7994cdfeb7c7fa0
I20260811 07:27:34.642088 20617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:34.642707 20617 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:34.643064 20617 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Loaded TSK: 0
I20260811 07:27:34.643709 20617 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:34.668089 20029 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45350:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:34.671195 20029 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:34.674460 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.674138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51502)
0811 07:27:34.674270 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.674351 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 07:27:34.674573 19821 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [term 3 FOLLOWER]: Refusing update from remote peer e7b61d71e1de4490994109811ff49597: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 07:27:34.675084 20615 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 07:27:34.675263 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.675003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.0.0.1:51514)
0811 07:27:34.675121 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.675198 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 07:27:34.675450 20001 consensus_peers.cc:487] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 -> Peer c31f3133893548b189affce91a28e502 (127.11.248.62:36723): Couldn't send request to peer c31f3133893548b189affce91a28e502. Status: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 07:27:34.676637 20619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7b61d71e1de4490994109811ff49597. Latest consensus state: current_term: 3 leader_uuid: "e7b61d71e1de4490994109811ff49597" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:34.676787 20619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:34.677897 20612 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "e7b61d71e1de4490994109811ff49597" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:34.678035 20612 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:34.678320 20619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "e7b61d71e1de4490994109811ff49597" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c31f3133893548b189affce91a28e502" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36723 } } peers { permanent_uuid: "00cb63df36da41e9b37dc36e2be1bba5" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 32985 } attrs { promote: false } } peers { permanent_uuid: "e7b61d71e1de4490994109811ff49597" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 44791 } attrs { promote: false } } }
I20260811 07:27:34.678736 20619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00cb63df36da41e9b37dc36e2be1bba5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:27:34.679101 20620 mvcc.cc:205] Tried to move back new op lower bound from 7317230611141296128 to 7317230610996633600. Current Snapshot: MvccSnapshot[applied={T|T < 7317230611141296128 or (T in {7317230611141296128})}]
I20260811 07:27:34.688728 20613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.684104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:44571 (local address 127.0.0.1:33894)
0811 07:27:34.684225 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.684244 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:34.684338 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:34.684904 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:34.684907 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:34.684938 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:34.685050 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.685059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.686208 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.686211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.687385 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.687394 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.688288 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.688381 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.688409 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:27:34.688497 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:27:34.688581 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":1}
I20260811 07:27:34.688747 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.684251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33894 (local address 127.11.248.2:44571)
0811 07:27:34.684599 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:34.684604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:34.684618 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:27:34.684674 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:34.684677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:34.684733 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:34.685175 (+ 442us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:34.685302 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.686076 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.687536 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.688166 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688267 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.688332 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:34.688523 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 07:27:34.688597 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":77,"threads_started":1}
I20260811 07:27:34.689138 20627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.684657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:46757 (local address 127.0.0.1:47932)
0811 07:27:34.685312 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.685328 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:34.685423 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:34.685802 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:34.685807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:34.685826 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:34.685899 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.685904 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.686692 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.686698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.687682 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.687691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.688681 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.688770 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.688799 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:27:34.688902 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:27:34.688989 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":93,"thread_start_us":105,"threads_started":1}
I20260811 07:27:34.689314 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.684605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39811 (local address 127.0.0.1:57476)
0811 07:27:34.685192 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.685207 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:34.685292 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:34.685609 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:34.685612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:34.685627 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:34.685735 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.685741 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.686759 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.686762 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.687924 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.687933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.688948 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.689035 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.689056 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:27:34.689124 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:27:34.689187 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":24,"thread_start_us":93,"threads_started":1}
I20260811 07:27:34.689708 20630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.685049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47932 (local address 127.11.248.1:46757)
0811 07:27:34.685486 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:34.685493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:34.685508 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:34.685557 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:34.685560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:34.685611 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:34.685693 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:34.686022 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.686570 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.687833 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.688468 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688566 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.688626 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:34.689464 (+ 838us) server_negotiation.cc:299] Negotiation successful
0811 07:27:34.689550 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":74,"threads_started":1}
I20260811 07:27:34.689734 20629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.684724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57476 (local address 127.11.248.3:39811)
0811 07:27:34.685009 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:34.685013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:34.685376 (+ 363us) server_negotiation.cc:407] Connection header received
0811 07:27:34.685451 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:34.685454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:34.685504 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:34.685591 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:34.685874 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.686623 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688062 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.688665 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.688778 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.688879 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:34.689524 (+ 645us) server_negotiation.cc:299] Negotiation successful
0811 07:27:34.689604 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":103,"threads_started":1}
I20260811 07:27:34.689919 20292 tablet_service.cc:1467] Processing CreateTablet for tablet fd528ffe73c44220ae89becb1204ea95 (DEFAULT_TABLE table=test-table [id=48e9a3981a3e44e1ba137ab2020f23a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:34.690222 20292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd528ffe73c44220ae89becb1204ea95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:34.690230 20447 tablet_service.cc:1467] Processing CreateTablet for tablet fd528ffe73c44220ae89becb1204ea95 (DEFAULT_TABLE table=test-table [id=48e9a3981a3e44e1ba137ab2020f23a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:34.690456 20447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd528ffe73c44220ae89becb1204ea95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:34.692631 20631 tablet_bootstrap.cc:492] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Bootstrap starting.
I20260811 07:27:34.692759 20632 tablet_bootstrap.cc:492] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Bootstrap starting.
I20260811 07:27:34.692857 20144 tablet_service.cc:1467] Processing CreateTablet for tablet fd528ffe73c44220ae89becb1204ea95 (DEFAULT_TABLE table=test-table [id=48e9a3981a3e44e1ba137ab2020f23a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:34.693126 20144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd528ffe73c44220ae89becb1204ea95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:34.693625 20631 tablet_bootstrap.cc:654] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:34.693751 20632 tablet_bootstrap.cc:654] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:34.694974 20631 tablet_bootstrap.cc:492] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: No bootstrap required, opened a new log
I20260811 07:27:34.695066 20631 ts_tablet_manager.cc:1397] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:27:34.695073 20632 tablet_bootstrap.cc:492] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: No bootstrap required, opened a new log
I20260811 07:27:34.695156 20632 ts_tablet_manager.cc:1397] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:27:34.695525 20631 raft_consensus.cc:348] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.695652 20631 raft_consensus.cc:374] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:34.695582 20632 raft_consensus.cc:348] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.695688 20631 raft_consensus.cc:729] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f271ffa5d374510817edc221c97368d, State: Initialized, Role: FOLLOWER
I20260811 07:27:34.695705 20632 raft_consensus.cc:374] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:34.695742 20632 raft_consensus.cc:729] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447bb3b9dbc64b86a7207e7759463ee1, State: Initialized, Role: FOLLOWER
I20260811 07:27:34.695814 20635 tablet_bootstrap.cc:492] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6: Bootstrap starting.
I20260811 07:27:34.695814 20631 consensus_queue.cc:260] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.695892 20632 consensus_queue.cc:260] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.696209 20631 ts_tablet_manager.cc:1428] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:34.696255 20632 ts_tablet_manager.cc:1428] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:34.696985 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.696659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:59851)
0811 07:27:34.696848 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.696909 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 07:27:34.697826 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.697556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:53031)
0811 07:27:34.697709 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.697755 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 07:27:34.697989 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.697710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:50111)
0811 07:27:34.697846 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.697903 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 07:27:34.698623 20635 tablet_bootstrap.cc:654] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:34.699363 20516 heartbeater.cc:503] Master 127.11.248.60:44791 was elected leader, sending a full tablet report...
I20260811 07:27:34.699671 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.699394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:54425)
0811 07:27:34.699554 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.699606 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 07:27:34.700347 20366 heartbeater.cc:503] Master 127.11.248.60:44791 was elected leader, sending a full tablet report...
I20260811 07:27:34.701063 20635 tablet_bootstrap.cc:492] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6: No bootstrap required, opened a new log
I20260811 07:27:34.701186 20635 ts_tablet_manager.cc:1397] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 07:27:34.701717 20635 raft_consensus.cc:348] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.701851 20635 raft_consensus.cc:374] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:34.701898 20635 raft_consensus.cc:729] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a692028ce98d454b9697619eaeaecfc6, State: Initialized, Role: FOLLOWER
I20260811 07:27:34.702040 20635 consensus_queue.cc:260] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.702399 20635 ts_tablet_manager.cc:1428] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:34.703013 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.702728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:44529)
0811 07:27:34.702864 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.702920 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 07:27:34.703809 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.703466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:33929)
0811 07:27:34.703681 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.703734 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260811 07:27:34.703917 20215 heartbeater.cc:503] Master 127.11.248.60:44791 was elected leader, sending a full tablet report...
I20260811 07:27:34.782668 20640 raft_consensus.cc:482] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:34.782827 20640 raft_consensus.cc:504] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.784034 20640 leader_election.cc:288] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571), 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811)
I20260811 07:27:34.788264 20609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.784251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:44571 (local address 127.11.248.1:53309)
0811 07:27:34.784551 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.784567 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:34.784687 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:34.785038 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:34.785041 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:34.785062 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:34.785243 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.785253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.786117 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.786121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.787060 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.787069 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.787765 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.787769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.787926 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.787950 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:27:34.788049 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 07:27:34.788128 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":61}
I20260811 07:27:34.788264 20629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.784399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:36603 (local address 127.11.248.3:39811)
0811 07:27:34.784554 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:34.784559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:34.784878 (+ 319us) server_negotiation.cc:407] Connection header received
0811 07:27:34.785040 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:34.785043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:34.785089 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:34.785170 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:34.785470 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.785999 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.787192 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.787613 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.787754 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.787819 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:34.788045 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 07:27:34.788128 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:27:34.788268 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.784575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:53309 (local address 127.11.248.2:44571)
0811 07:27:34.784711 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:34.784716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:34.784732 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:34.784827 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:34.784833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:34.784899 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:34.784979 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:34.785376 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.785990 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.787197 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.787611 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.787773 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.787830 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:34.788083 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 07:27:34.788160 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 07:27:34.788306 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.784305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39811 (local address 127.11.248.1:36603)
0811 07:27:34.784760 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.784776 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:34.784927 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:34.785190 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:34.785192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:34.785207 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:34.785332 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.785339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.786162 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.786165 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.787058 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:34.787068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.787766 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.787771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:34.787917 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.787936 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:27:34.788001 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 07:27:34.788107 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":11,"thread_start_us":155,"threads_started":1}
I20260811 07:27:34.789068 20316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd528ffe73c44220ae89becb1204ea95" candidate_uuid: "a692028ce98d454b9697619eaeaecfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f271ffa5d374510817edc221c97368d" is_pre_election: true
I20260811 07:27:34.789184 20469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd528ffe73c44220ae89becb1204ea95" candidate_uuid: "a692028ce98d454b9697619eaeaecfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447bb3b9dbc64b86a7207e7759463ee1" is_pre_election: true
W20260811 07:27:34.789264 20519 tablet.cc:2369] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:34.789354 20469 raft_consensus.cc:2454] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a692028ce98d454b9697619eaeaecfc6 in term 0.
I20260811 07:27:34.789353 20316 raft_consensus.cc:2454] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a692028ce98d454b9697619eaeaecfc6 in term 0.
I20260811 07:27:34.789817 20092 leader_election.cc:302] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447bb3b9dbc64b86a7207e7759463ee1, a692028ce98d454b9697619eaeaecfc6; no voters:
I20260811 07:27:34.790143 20640 raft_consensus.cc:2781] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:34.790207 20640 raft_consensus.cc:482] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:34.790246 20640 raft_consensus.cc:3037] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:34.791337 20640 raft_consensus.cc:504] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.791707 20640 leader_election.cc:288] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571), 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811)
I20260811 07:27:34.792120 20469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd528ffe73c44220ae89becb1204ea95" candidate_uuid: "a692028ce98d454b9697619eaeaecfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447bb3b9dbc64b86a7207e7759463ee1"
I20260811 07:27:34.792120 20316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd528ffe73c44220ae89becb1204ea95" candidate_uuid: "a692028ce98d454b9697619eaeaecfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f271ffa5d374510817edc221c97368d"
I20260811 07:27:34.792261 20469 raft_consensus.cc:3037] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:34.792261 20316 raft_consensus.cc:3037] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:34.793588 20316 raft_consensus.cc:2454] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a692028ce98d454b9697619eaeaecfc6 in term 1.
I20260811 07:27:34.793588 20469 raft_consensus.cc:2454] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a692028ce98d454b9697619eaeaecfc6 in term 1.
I20260811 07:27:34.793919 20092 leader_election.cc:302] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447bb3b9dbc64b86a7207e7759463ee1, a692028ce98d454b9697619eaeaecfc6; no voters:
I20260811 07:27:34.794229 20640 raft_consensus.cc:2781] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:34.794478 20640 raft_consensus.cc:686] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [term 1 LEADER]: Becoming Leader. State: Replica: a692028ce98d454b9697619eaeaecfc6, State: Running, Role: LEADER
I20260811 07:27:34.794772 20640 consensus_queue.cc:237] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } }
I20260811 07:27:34.795413 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.795152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:46511)
0811 07:27:34.795283 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.795348 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 07:27:34.797921 20030 catalog_manager.cc:5495] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a692028ce98d454b9697619eaeaecfc6 (127.11.248.1). New cstate: current_term: 1 leader_uuid: "a692028ce98d454b9697619eaeaecfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a692028ce98d454b9697619eaeaecfc6" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 46757 } health_report { overall_health: HEALTHY } } }
W20260811 07:27:34.798853 20369 tablet.cc:2369] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:34.814680 20630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.810995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.11.248.1:46757)
0811 07:27:34.811147 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:34.811151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:34.811163 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:27:34.811242 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:34.811245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:34.811302 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:34.811427 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:34.811701 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.812236 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.813137 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:34.813359 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:34.813470 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:34.813766 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:34.814224 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:34.814386 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:34.814468 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 07:27:34.814530 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:27:34.818164 20469 raft_consensus.cc:1261] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Refusing update from remote peer a692028ce98d454b9697619eaeaecfc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:34.818265 20316 raft_consensus.cc:1261] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Refusing update from remote peer a692028ce98d454b9697619eaeaecfc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:34.818918 20642 consensus_queue.cc:1035] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "447bb3b9dbc64b86a7207e7759463ee1" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:34.819137 20640 consensus_queue.cc:1035] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f271ffa5d374510817edc221c97368d" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:34.821743 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.821404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:47759)
0811 07:27:34.821578 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.821649 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 07:27:34.821887 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.821604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:41717)
0811 07:27:34.821757 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.821809 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 07:27:34.826398 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.825318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:52685)
0811 07:27:34.826219 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.826306 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":809}
I20260811 07:27:34.827013 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.826657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.3:33849)
0811 07:27:34.826877 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.826933 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260811 07:27:34.830207 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.829889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.2:51751)
0811 07:27:34.830056 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.830121 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 07:27:34.833369 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.832959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36723 (local address 127.11.248.1:49271)
0811 07:27:34.833214 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.833283 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:36723: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260811 07:27:34.834870 20030 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45350:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:34.835065 20030 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45350:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:34.840180 20030 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e7b61d71e1de4490994109811ff49597: Sending DeleteTablet for 3 replicas of tablet fd528ffe73c44220ae89becb1204ea95
I20260811 07:27:34.840988 20292 tablet_service.cc:1514] Processing DeleteTablet for tablet fd528ffe73c44220ae89becb1204ea95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:34 UTC) from {username='oryx', principal='oryx/127.11.248.60@KRBTEST.COM'} at 127.0.0.1:33894
I20260811 07:27:34.841202 20447 tablet_service.cc:1514] Processing DeleteTablet for tablet fd528ffe73c44220ae89becb1204ea95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:34 UTC) from {username='oryx', principal='oryx/127.11.248.60@KRBTEST.COM'} at 127.0.0.1:57476
I20260811 07:27:34.841431 20144 tablet_service.cc:1514] Processing DeleteTablet for tablet fd528ffe73c44220ae89becb1204ea95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:34 UTC) from {username='oryx', principal='oryx/127.11.248.60@KRBTEST.COM'} at 127.0.0.1:47932
I20260811 07:27:34.841928 20658 tablet_replica.cc:330] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: stopping tablet replica
I20260811 07:27:34.842059 20659 tablet_replica.cc:330] T fd528ffe73c44220ae89becb1204ea95 P a692028ce98d454b9697619eaeaecfc6: stopping tablet replica
I20260811 07:27:34.842141 20658 raft_consensus.cc:2229] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:34.842238 20657 tablet_replica.cc:330] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: stopping tablet replica
I20260811 07:27:34.842391 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19972
I20260811 07:27:34.842387 20658 raft_consensus.cc:2258] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:34.845989 20657 raft_consensus.cc:2229] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:34.846207 20657 raft_consensus.cc:2258] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:34.846336 20658 ts_tablet_manager.cc:1905] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:34.846999 20657 ts_tablet_manager.cc:1905] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:34.849669 20657 ts_tablet_manager.cc:1918] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:34.849792 20657 log.cc:1196] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/fd528ffe73c44220ae89becb1204ea95
I20260811 07:27:34.850112 20657 ts_tablet_manager.cc:1939] T fd528ffe73c44220ae89becb1204ea95 P 4f271ffa5d374510817edc221c97368d: Deleting consensus metadata
I20260811 07:27:34.850764 20658 ts_tablet_manager.cc:1918] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:34.850910 20658 log.cc:1196] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/fd528ffe73c44220ae89becb1204ea95
I20260811 07:27:34.850929 20001 catalog_manager.cc:4841] TS 4f271ffa5d374510817edc221c97368d (127.11.248.2:44571): tablet fd528ffe73c44220ae89becb1204ea95 (table test-table [id=48e9a3981a3e44e1ba137ab2020f23a7]) successfully deleted
I20260811 07:27:34.851315 20658 ts_tablet_manager.cc:1939] T fd528ffe73c44220ae89becb1204ea95 P 447bb3b9dbc64b86a7207e7759463ee1: Deleting consensus metadata
I20260811 07:27:34.853040 20007 catalog_manager.cc:4841] TS 447bb3b9dbc64b86a7207e7759463ee1 (127.11.248.3:39811): tablet fd528ffe73c44220ae89becb1204ea95 (table test-table [id=48e9a3981a3e44e1ba137ab2020f23a7]) successfully deleted
I20260811 07:27:34.854995 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:34.854613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:46757 (local address 127.0.0.1:47952)
0811 07:27:34.854821 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:34.854895 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:46757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 07:27:34.855067 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 20223
W20260811 07:27:34.855221 20008 catalog_manager.cc:4584] TS a692028ce98d454b9697619eaeaecfc6 (127.11.248.1:46757): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fd528ffe73c44220ae89becb1204ea95: Network error: Client connection negotiation failed: client connection to 127.11.248.1:46757: connect: Connection refused (error 111)
I20260811 07:27:34.868539 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 20373
I20260811 07:27:34.875738 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19652
I20260811 07:27:34.886129 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 19780
2026-08-11T07:27:34Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7545 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:34 dist-test-slave-77v9 krb5kdc[20662](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:34 dist-test-slave-77v9 krb5kdc[20662](info): set up 2 sockets
Aug 11 07:27:34 dist-test-slave-77v9 krb5kdc[20662](info): commencing operation
krb5kdc: starting...
W20260811 07:27:36.032723 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab.
Entry for principal oryx/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab.
I20260811 07:27:36.172109 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39925
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab
--principal=oryx/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:39925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:36.287616 20676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:36.287959 20676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:36.288038 20676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:36.292307 20676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:36.292392 20676 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:27:36.292421 20676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:36.292460 20676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:36.292501 20676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:36.292536 20676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:36.298606 20676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:39925
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.62.keytab
--principal=oryx/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:36.300084 20676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:36.301360 20676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:36.310190 20684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:36.310214 20682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:36.310196 20681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:36.310376 20676 server_base.cc:1034] running on GCE node
I20260811 07:27:36.311146 20676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:36.312310 20676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:36.313483 20676 hybrid_clock.cc:648] HybridClock initialized: now 1786433256313450 us; error 43 us; skew 500 ppm
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:36.316505 20676 init.cc:377] Logged in from keytab as oryx/127.11.248.62@KRBTEST.COM (short username oryx)
I20260811 07:27:36.317502 20676 webserver.cc:460] Webserver started at http://127.11.248.62:46525/ using document root <none> and password file <none>
I20260811 07:27:36.318112 20676 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:36.318189 20676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:36.318382 20676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:36.320549 20676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "4fdab615b3894a48850748f3861a18f0"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "587693268ca196eb5c7dff8c2197736f"
server_key_iv: "91989bf758a1d046b8aa9d08a3754082"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.321147 20676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "4fdab615b3894a48850748f3861a18f0"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "587693268ca196eb5c7dff8c2197736f"
server_key_iv: "91989bf758a1d046b8aa9d08a3754082"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.324941 20676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:36.327353 20694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:36.328747 20676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 07:27:36.328958 20676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "4fdab615b3894a48850748f3861a18f0"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "587693268ca196eb5c7dff8c2197736f"
server_key_iv: "91989bf758a1d046b8aa9d08a3754082"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.329078 20676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:36.350854 20676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:36.354557 20676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:36.354743 20676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:36.363973 20676 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:39925
I20260811 07:27:36.363989 20760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:39925 every 8 connection(s)
I20260811 07:27:36.365084 20676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:36.367930 20761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:36.370306 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 20676
I20260811 07:27:36.370467 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:36.370784 12256 external_mini_cluster.cc:1428] Setting key 725cb90ca68bbcc17657d5a60bbd5945
I20260811 07:27:36.374691 20761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Bootstrap starting.
I20260811 07:27:36.377151 20761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:36.377955 20761 log.cc:824] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:36.379998 20761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: No bootstrap required, opened a new log
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:36.383989 20761 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fdab615b3894a48850748f3861a18f0" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39925 } }
I20260811 07:27:36.384285 20761 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:36.384378 20761 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdab615b3894a48850748f3861a18f0, State: Initialized, Role: FOLLOWER
I20260811 07:27:36.384984 20761 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fdab615b3894a48850748f3861a18f0" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39925 } }
I20260811 07:27:36.385161 20761 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:36.385253 20761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:36.385370 20761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:36.386399 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.372444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39642 (local address 127.11.248.62:39925)
0811 07:27:36.373084 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:36.373101 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:36.373139 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:27:36.373842 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:36.373859 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:36.374230 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:36.374594 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:36.375468 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.376516 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.377596 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.378117 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.378286 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.381083 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:36.381088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:36.381103 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:36.381132 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:36.383073 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.383695 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.383700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.383705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.383827 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.384127 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.384130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.384132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.384677 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:36.384982 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:36.385215 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 07:27:36.385568 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":152,"threads_started":1}
I20260811 07:27:36.386585 20761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fdab615b3894a48850748f3861a18f0" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39925 } }
I20260811 07:27:36.387019 20761 leader_election.cc:302] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fdab615b3894a48850748f3861a18f0; no voters:
I20260811 07:27:36.387395 20761 leader_election.cc:288] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:36.387539 20766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:36.387916 20766 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4fdab615b3894a48850748f3861a18f0, State: Running, Role: LEADER
I20260811 07:27:36.388307 20766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fdab615b3894a48850748f3861a18f0" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39925 } }
I20260811 07:27:36.388765 20761 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:36.390105 20767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fdab615b3894a48850748f3861a18f0. Latest consensus state: current_term: 1 leader_uuid: "4fdab615b3894a48850748f3861a18f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fdab615b3894a48850748f3861a18f0" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39925 } } }
I20260811 07:27:36.390303 20767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:36.390178 20768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fdab615b3894a48850748f3861a18f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fdab615b3894a48850748f3861a18f0" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39925 } } }
I20260811 07:27:36.390395 20768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:36.390772 20777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:36.394212 20777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:36.400719 20777 catalog_manager.cc:1347] Generated new cluster ID: 38827662591e437bb72a6459029c39fc
I20260811 07:27:36.400879 20777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:36.412289 20777 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:36.413419 20777 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:36.420115 20777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Generated new TSK 0
I20260811 07:27:36.421041 20777 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab.
Entry for principal oryx/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab.
I20260811 07:27:36.457182 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:39925
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:36.579175 20790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:36.579587 20790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:36.579685 20790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:36.584044 20790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:36.584184 20790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:36.584271 20790 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:36.584357 20790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:36.590484 20790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:39925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:36.591815 20790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:36.593007 20790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:36.604091 20795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:36.604084 20798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:36.604084 20796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:36.604538 20790 server_base.cc:1034] running on GCE node
I20260811 07:27:36.605072 20790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:36.605859 20790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:36.607061 20790 hybrid_clock.cc:648] HybridClock initialized: now 1786433256606986 us; error 105 us; skew 500 ppm
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:36.610146 20790 init.cc:377] Logged in from keytab as oryx/127.11.248.1@KRBTEST.COM (short username oryx)
I20260811 07:27:36.611085 20790 webserver.cc:460] Webserver started at http://127.11.248.1:40903/ using document root <none> and password file <none>
I20260811 07:27:36.611642 20790 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:36.611706 20790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:36.611881 20790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:36.614152 20790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "492fc47b0850475893d7cf300b75568b"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "50c9ae10841e0ecbb43ab874fb3341ea"
server_key_iv: "2ff8f8c9703ef2b5ce98af9fd5860ddb"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.614746 20790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "492fc47b0850475893d7cf300b75568b"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "50c9ae10841e0ecbb43ab874fb3341ea"
server_key_iv: "2ff8f8c9703ef2b5ce98af9fd5860ddb"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.618882 20790 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:36.621613 20806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:36.622985 20790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:36.623102 20790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "492fc47b0850475893d7cf300b75568b"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "50c9ae10841e0ecbb43ab874fb3341ea"
server_key_iv: "2ff8f8c9703ef2b5ce98af9fd5860ddb"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.623263 20790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:36.652503 20790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:36.656037 20790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:36.656291 20790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:36.658004 20790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:36.658063 20790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:36.658105 20790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:36.658167 20790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:36.669821 20790 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:39795
I20260811 07:27:36.669879 20932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:39795 every 8 connection(s)
I20260811 07:27:36.671053 20790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:36.673591 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.659114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:36231 (local address 127.11.248.62:39925)
0811 07:27:36.659299 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:36.659305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:36.660236 (+ 931us) server_negotiation.cc:407] Connection header received
0811 07:27:36.661527 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:36.661530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:36.661596 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:36.661704 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:36.663117 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.663833 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.665205 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.665669 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.665824 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.669698 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:36.669702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:36.669704 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:36.669739 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:36.671372 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.672068 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.672074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.672075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.672178 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.672513 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.672515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.672516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.672710 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:36.672787 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:36.673337 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 07:27:36.673467 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:27:36.674500 20815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.659535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.11.248.1:36231)
0811 07:27:36.660033 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:36.660089 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:36.661290 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:36.661894 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:36.661901 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:36.662261 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:36.662949 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.662965 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.663977 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.663980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.665055 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.665066 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.665882 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.665887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.666232 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.667503 (+ 1271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:36.667521 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:36.669412 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:36.671570 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.671575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.671590 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.671926 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.672268 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.672270 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.672271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.672404 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.672801 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:36.672846 (+ 45us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:36.673099 (+ 253us) client_negotiation.cc:769] Sending connection context
0811 07:27:36.673263 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 07:27:36.673544 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":147,"threads_started":1}
I20260811 07:27:36.675885 20933 heartbeater.cc:347] Connected to a master server at 127.11.248.62:39925
I20260811 07:27:36.676056 20933 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:36.676497 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 20790
I20260811 07:27:36.676645 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:36.676668 20933 heartbeater.cc:511] Master 127.11.248.62:39925 requested a full tablet report, sending...
I20260811 07:27:36.677028 12256 external_mini_cluster.cc:1428] Setting key 7ae3843aae3424e19e10925ed1196bc0
I20260811 07:27:36.678401 20713 ts_manager.cc:194] Registered new tserver with Master: 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795)
I20260811 07:27:36.679989 20713 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:36231
I20260811 07:27:36.685860 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.678374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49945 (local address 127.11.248.62:39925)
0811 07:27:36.678623 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:36.678627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:36.678701 (+ 74us) server_negotiation.cc:407] Connection header received
0811 07:27:36.678884 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:36.678887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:36.678937 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:36.679031 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:36.679479 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.679999 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.681032 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.681272 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.681387 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.682643 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:36.682647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:36.682650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:36.682676 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:36.684092 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.684556 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.684560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.684562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.684652 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.685001 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.685004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.685006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.685189 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:36.685303 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:36.685575 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 07:27:36.685692 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260811 07:27:36.685879 20939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.678315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.11.248.1:49945)
0811 07:27:36.678616 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:36.678632 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:36.678780 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:36.679046 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:36.679049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:36.679255 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:36.679356 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.679361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.680129 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.680132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.680857 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.680867 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.681390 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.681394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.681544 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.682120 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:36.682132 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:36.682483 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:36.684213 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.684217 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.684219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.684449 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.684745 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.684749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.684752 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.684877 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.685291 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:36.685294 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:36.685397 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 07:27:36.685518 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 07:27:36.685678 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":1,"thread_start_us":117,"threads_started":1}
WARNING: no policy specified for oryx/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab.
Entry for principal oryx/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab.
I20260811 07:27:36.712162 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:39925
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:36.831090 20943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:36.831414 20943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:36.831493 20943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:36.835773 20943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:36.835881 20943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:36.835963 20943 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:36.836047 20943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:36.841687 20943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:39925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:36.842905 20943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:36.844012 20943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:36.854297 20948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:36.854399 20943 server_base.cc:1034] running on GCE node
W20260811 07:27:36.854611 20949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:36.854302 20951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:36.855430 20943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:36.856243 20943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:36.857478 20943 hybrid_clock.cc:648] HybridClock initialized: now 1786433256857467 us; error 39 us; skew 500 ppm
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:36.860483 20943 init.cc:377] Logged in from keytab as oryx/127.11.248.2@KRBTEST.COM (short username oryx)
I20260811 07:27:36.861490 20943 webserver.cc:460] Webserver started at http://127.11.248.2:32985/ using document root <none> and password file <none>
I20260811 07:27:36.862116 20943 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:36.862211 20943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:36.862468 20943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:36.864634 20943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "c55d663f0c494cc6966643c4e9748366"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "b4587153a188310dd70db833c60c568a"
server_key_iv: "9537b54b0466fa3b88658708a84650b9"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.865283 20943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "c55d663f0c494cc6966643c4e9748366"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "b4587153a188310dd70db833c60c568a"
server_key_iv: "9537b54b0466fa3b88658708a84650b9"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.869189 20943 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:36.871784 20958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:36.873190 20943 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:36.873343 20943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "c55d663f0c494cc6966643c4e9748366"
format_stamp: "Formatted at 2026-08-11 07:27:36 on dist-test-slave-77v9"
server_key: "b4587153a188310dd70db833c60c568a"
server_key_iv: "9537b54b0466fa3b88658708a84650b9"
server_key_version: "encryptionkey@0"
I20260811 07:27:36.873479 20943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:36.894111 20943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:36.897900 20943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:36.898144 20943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:36.899703 20943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:36.899786 20943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:36.899861 20943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:36.899915 20943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:27:36 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:36.911855 20943 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:42583
I20260811 07:27:36.913000 20943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:36.913023 21082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:42583 every 8 connection(s)
I20260811 07:27:36.915562 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.900649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:47235 (local address 127.11.248.62:39925)
0811 07:27:36.900795 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:36.900799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:36.902069 (+ 1270us) server_negotiation.cc:407] Connection header received
0811 07:27:36.903271 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:36.903277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:36.903353 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:36.903457 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:36.905134 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.905793 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.907341 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.907757 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.907903 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.911112 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:36.911117 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:36.911120 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:36.911162 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:36.913204 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.913973 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.913977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.913979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.914085 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.914486 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.914488 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.914489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.914676 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:36.914754 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:36.915330 (+ 576us) server_negotiation.cc:299] Negotiation successful
0811 07:27:36.915439 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:27:36.916550 20967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.901256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.11.248.2:47235)
0811 07:27:36.901879 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:36.901929 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:36.902987 (+ 1058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:36.903641 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:36.903649 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:36.904145 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:36.904954 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.904983 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.905953 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.905957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.907194 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.907208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.907958 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.907962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.908161 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.909009 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:36.909029 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:36.910905 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:36.913354 (+ 2449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.913382 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.913401 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.913814 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.914214 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.914217 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.914219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.914357 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.914805 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:36.914812 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:36.915091 (+ 279us) client_negotiation.cc:769] Sending connection context
0811 07:27:36.915270 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 07:27:36.915547 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":136,"threads_started":1}
I20260811 07:27:36.917958 21083 heartbeater.cc:347] Connected to a master server at 127.11.248.62:39925
I20260811 07:27:36.918113 21083 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:36.918675 21083 heartbeater.cc:511] Master 127.11.248.62:39925 requested a full tablet report, sending...
I20260811 07:27:36.919816 20714 ts_manager.cc:194] Registered new tserver with Master: c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:36.920671 20714 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:47235
I20260811 07:27:36.920975 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 20943
I20260811 07:27:36.921104 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:36.921428 12256 external_mini_cluster.cc:1428] Setting key 9e725b798ba21b27fd279219ec267ca0
I20260811 07:27:36.928064 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.920376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:37493 (local address 127.11.248.62:39925)
0811 07:27:36.920590 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:36.920595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:36.920642 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:27:36.920796 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:36.920799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:36.920871 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:36.920971 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:36.921579 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.922240 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.923256 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.923480 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.923588 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.924732 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:36.924736 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:36.924738 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:36.924762 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:36.926287 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.926774 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.926780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.926783 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.926898 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:36.927171 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:36.927175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:36.927178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:36.927408 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:36.927522 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:36.927782 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 07:27:36.927895 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260811 07:27:36.928107 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:36.920319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.11.248.2:37493)
0811 07:27:36.920579 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:36.920591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:36.920691 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:36.921105 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:36.921107 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:36.921320 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:36.921446 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.921453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.922381 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.922384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.923113 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:36.923122 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:36.923603 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:36.923606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:36.923706 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:36.924247 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:36.924259 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:36.924595 (+ 336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:36.926426 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.926429 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.926431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.926666 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.926979 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:36.926983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:36.926985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:36.927073 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:36.927510 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:36.927513 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:36.927612 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 07:27:36.927724 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 07:27:36.927895 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
WARNING: no policy specified for oryx/127.11.248.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab.
Entry for principal oryx/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab.
I20260811 07:27:36.952710 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:39925
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:37.071667 21092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:37.071995 21092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:37.072043 21092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:37.076417 21092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:37.076496 21092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:37.076539 21092 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:27:37.076620 21092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:37.082687 21092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.248.62:39925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:37.083863 21092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:37.084975 21092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:37.095408 21101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:37.095440 21098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:37.095440 21099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:37.095825 21092 server_base.cc:1034] running on GCE node
I20260811 07:27:37.096314 21092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:37.097105 21092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:37.098305 21092 hybrid_clock.cc:648] HybridClock initialized: now 1786433257098278 us; error 40 us; skew 500 ppm
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:37.101696 21092 init.cc:377] Logged in from keytab as oryx/127.11.248.3@KRBTEST.COM (short username oryx)
I20260811 07:27:37.102819 21092 webserver.cc:460] Webserver started at http://127.11.248.3:43853/ using document root <none> and password file <none>
I20260811 07:27:37.103458 21092 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:37.103571 21092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:37.103858 21092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:37.106230 21092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "6f95fb1a510b4ce2a503618b87b0cca4"
format_stamp: "Formatted at 2026-08-11 07:27:37 on dist-test-slave-77v9"
server_key: "c188ed2ce912b80e30621512608176d4"
server_key_iv: "28e5ce936128fcf8cb696ccc20f8e36f"
server_key_version: "encryptionkey@0"
I20260811 07:27:37.106932 21092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "6f95fb1a510b4ce2a503618b87b0cca4"
format_stamp: "Formatted at 2026-08-11 07:27:37 on dist-test-slave-77v9"
server_key: "c188ed2ce912b80e30621512608176d4"
server_key_iv: "28e5ce936128fcf8cb696ccc20f8e36f"
server_key_version: "encryptionkey@0"
I20260811 07:27:37.111713 21092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:27:37.114899 21108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:37.116185 21092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:37.116344 21092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "6f95fb1a510b4ce2a503618b87b0cca4"
format_stamp: "Formatted at 2026-08-11 07:27:37 on dist-test-slave-77v9"
server_key: "c188ed2ce912b80e30621512608176d4"
server_key_iv: "28e5ce936128fcf8cb696ccc20f8e36f"
server_key_version: "encryptionkey@0"
I20260811 07:27:37.116488 21092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:37.131050 21092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:37.134788 21092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:37.135033 21092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:37.136638 21092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:37.136718 21092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:37.136792 21092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:37.136875 21092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:37.148803 21092 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:44693
I20260811 07:27:37.148936 21231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:44693 every 8 connection(s)
I20260811 07:27:37.150069 21092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:37.151353 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 21092
I20260811 07:27:37.151512 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:37.151831 12256 external_mini_cluster.cc:1428] Setting key eba2c706c33892241a483f384aab5cfe
I20260811 07:27:37.152380 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.137485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:50293 (local address 127.11.248.62:39925)
0811 07:27:37.137634 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.137638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.138913 (+ 1275us) server_negotiation.cc:407] Connection header received
0811 07:27:37.140147 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.140151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.140236 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.140344 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:37.141863 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.142457 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.143822 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.144237 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.144381 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.148001 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:37.148008 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:37.148014 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:37.148053 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:37.149969 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.150566 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.150571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.150573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.150670 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.151086 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.151089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.151117 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.151373 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:37.151515 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.152071 (+ 556us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.152207 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:27:37.153366 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.138120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.11.248.3:50293)
0811 07:27:37.138654 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.138777 (+ 123us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.139827 (+ 1050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.140534 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.140541 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.141034 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:37.141669 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.141702 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.142613 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.142618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.143590 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.143605 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.144448 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.144456 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.144842 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.145596 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:37.145620 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:37.147792 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:37.150104 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:37.150108 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:37.150142 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:37.150442 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:37.150785 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:37.150788 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:37.150790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:37.150974 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:37.151510 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:37.151517 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:37.151792 (+ 275us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.152009 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.152332 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":149,"threads_started":1}
I20260811 07:27:37.154706 21233 heartbeater.cc:347] Connected to a master server at 127.11.248.62:39925
I20260811 07:27:37.154842 21233 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:37.155340 21233 heartbeater.cc:511] Master 127.11.248.62:39925 requested a full tablet report, sending...
I20260811 07:27:37.156400 20713 ts_manager.cc:194] Registered new tserver with Master: 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693)
I20260811 07:27:37.157299 20713 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:50293
I20260811 07:27:37.165467 21239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.157240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.11.248.3:41035)
0811 07:27:37.157584 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.157617 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.157722 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.157979 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.157982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.158213 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:37.158319 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.158326 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.159129 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.159132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.159737 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.159746 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.160256 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.160260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.160358 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.161005 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:37.161018 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:37.161387 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:37.163617 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:37.163620 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:37.163623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:37.163911 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:37.164256 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:37.164258 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:37.164260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:37.164360 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:37.164794 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:37.164797 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:37.164954 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.165077 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.165245 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":122,"threads_started":1}
I20260811 07:27:37.165485 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.157349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:41035 (local address 127.11.248.62:39925)
0811 07:27:37.157473 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.157478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.157703 (+ 225us) server_negotiation.cc:407] Connection header received
0811 07:27:37.157805 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.157807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.157855 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.157959 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:37.158456 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.158984 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.159890 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.160129 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.160252 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.161543 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:37.161547 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:37.161550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:37.161577 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:37.163449 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.164045 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.164049 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.164051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.164148 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.164464 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.164468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.164470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.164673 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:37.164793 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.165194 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.165333 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:27:37.166563 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:27:37.193476 20764 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:37.186575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39646 (local address 127.11.248.62:39925)
0811 07:27:37.186709 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.186713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.186727 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:27:37.186773 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.186775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.186816 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.186890 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:37.187637 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.188180 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.189226 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.189636 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.189786 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.193337 (+ 3551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39646: BlockingRecv error: recv got EOF from 127.0.0.1:39646 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433257, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:37.203382 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.195003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39650 (local address 127.11.248.62:39925)
0811 07:27:37.195123 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.195126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.195220 (+ 94us) server_negotiation.cc:407] Connection header received
0811 07:27:37.195319 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.195321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.195361 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.195433 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:37.196063 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.196554 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.197535 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.197736 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.197815 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.200359 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:37.200361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:37.200364 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:37.200390 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:37.201919 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.202311 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.202314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.202315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.202392 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.202627 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.202629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.202630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.202804 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:37.202911 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.203151 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.203254 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 07:27:37.206580 20714 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:37.209913 20714 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:37.226102 21260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.219702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:39795 (local address 127.0.0.1:46468)
0811 07:27:37.220889 (+ 1187us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.220903 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.220996 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.221626 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.221629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.221644 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:37.221758 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.221765 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.223237 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.223240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.224214 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.224224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.225469 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.225473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.225607 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.225648 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.225774 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.225928 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260811 07:27:37.226143 21261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.220156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.11.248.1:39795)
0811 07:27:37.220556 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.220564 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.221002 (+ 438us) server_negotiation.cc:407] Connection header received
0811 07:27:37.221128 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.221132 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.221309 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.221456 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:37.221891 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.223126 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.224393 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.225076 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.225205 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.225386 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.225848 (+ 462us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.225983 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":105,"threads_started":1}
I20260811 07:27:37.227097 21257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.219150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:44693 (local address 127.0.0.1:59722)
0811 07:27:37.219754 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.219815 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.220018 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.221394 (+ 1376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.221401 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.221425 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:37.221585 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.221592 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.223266 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.223270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.225033 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.225047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.226638 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.226642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.226749 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.226787 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.226870 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.226950 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":226,"thread_start_us":129,"threads_started":1}
I20260811 07:27:37.227298 21259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.220019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:42583 (local address 127.0.0.1:34140)
0811 07:27:37.220571 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.220588 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.220692 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.221478 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.221481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.221500 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:37.221618 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.221625 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.223151 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.223154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.225033 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.225047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.226861 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.226865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.226964 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.226989 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.227085 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.227171 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":217,"thread_start_us":112,"threads_started":1}
I20260811 07:27:37.227475 21262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.220512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.11.248.2:42583)
0811 07:27:37.221014 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.221026 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.221047 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:27:37.221121 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.221126 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.221309 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.221765 (+ 456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:37.221909 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.223023 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.225177 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.226740 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.226860 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.227014 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.227171 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.227265 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":160,"threads_started":1}
I20260811 07:27:37.228150 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.219277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59722 (local address 127.11.248.3:44693)
0811 07:27:37.220717 (+ 1440us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.220733 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.220763 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:27:37.220877 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.220883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.221168 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.221362 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:37.221719 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.223071 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.225202 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.225866 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.225980 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.226141 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.227885 (+ 1744us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.227996 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1286,"thread_start_us":140,"threads_started":1}
I20260811 07:27:37.229986 21013 tablet_service.cc:1467] Processing CreateTablet for tablet f773400296944f11a6e61afea1d16012 (DEFAULT_TABLE table=test-table [id=63e6b525dbb448f0bc76e045ecbe7b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:37.229977 20861 tablet_service.cc:1467] Processing CreateTablet for tablet f773400296944f11a6e61afea1d16012 (DEFAULT_TABLE table=test-table [id=63e6b525dbb448f0bc76e045ecbe7b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:37.231104 21013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f773400296944f11a6e61afea1d16012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.231149 20861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f773400296944f11a6e61afea1d16012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.230846 21162 tablet_service.cc:1467] Processing CreateTablet for tablet f773400296944f11a6e61afea1d16012 (DEFAULT_TABLE table=test-table [id=63e6b525dbb448f0bc76e045ecbe7b6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:37.231894 21162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f773400296944f11a6e61afea1d16012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.238255 21263 tablet_bootstrap.cc:492] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Bootstrap starting.
I20260811 07:27:37.239832 21266 tablet_bootstrap.cc:492] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Bootstrap starting.
I20260811 07:27:37.239959 21264 tablet_bootstrap.cc:492] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Bootstrap starting.
I20260811 07:27:37.241333 21263 tablet_bootstrap.cc:654] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.242013 21266 tablet_bootstrap.cc:654] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.242159 21264 tablet_bootstrap.cc:654] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.242424 21263 log.cc:824] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:37.242848 21266 log.cc:824] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:37.243062 21264 log.cc:824] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:37.244720 21263 tablet_bootstrap.cc:492] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: No bootstrap required, opened a new log
I20260811 07:27:37.244994 21263 ts_tablet_manager.cc:1397] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:27:37.245042 21264 tablet_bootstrap.cc:492] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: No bootstrap required, opened a new log
I20260811 07:27:37.245244 21264 ts_tablet_manager.cc:1397] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260811 07:27:37.248229 21263 raft_consensus.cc:348] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.248560 21263 raft_consensus.cc:374] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.248626 21263 raft_consensus.cc:729] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55d663f0c494cc6966643c4e9748366, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.249230 21263 consensus_queue.cc:260] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.249912 21266 tablet_bootstrap.cc:492] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: No bootstrap required, opened a new log
I20260811 07:27:37.250039 21083 heartbeater.cc:503] Master 127.11.248.62:39925 was elected leader, sending a full tablet report...
I20260811 07:27:37.250157 21266 ts_tablet_manager.cc:1397] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260811 07:27:37.250473 21263 ts_tablet_manager.cc:1428] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 07:27:37.249730 21264 raft_consensus.cc:348] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.251313 21264 raft_consensus.cc:374] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.251394 21264 raft_consensus.cc:729] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.251892 21264 consensus_queue.cc:260] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.252631 20933 heartbeater.cc:503] Master 127.11.248.62:39925 was elected leader, sending a full tablet report...
I20260811 07:27:37.254148 21264 ts_tablet_manager.cc:1428] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260811 07:27:37.254700 21266 raft_consensus.cc:348] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.255095 21266 raft_consensus.cc:374] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.255168 21266 raft_consensus.cc:729] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.255671 21266 consensus_queue.cc:260] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.256477 21233 heartbeater.cc:503] Master 127.11.248.62:39925 was elected leader, sending a full tablet report...
I20260811 07:27:37.256906 21266 ts_tablet_manager.cc:1428] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260811 07:27:37.401172 21234 tablet.cc:2369] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:27:37.414356 21084 tablet.cc:2369] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:27:37.422513 20934 tablet.cc:2369] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:27:37.482757 21271 raft_consensus.cc:482] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:37.483000 21271 raft_consensus.cc:504] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.484210 21271 leader_election.cc:288] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693), c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:37.488723 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.484713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:55811 (local address 127.11.248.3:44693)
0811 07:27:37.484954 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.484959 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.485092 (+ 133us) server_negotiation.cc:407] Connection header received
0811 07:27:37.485329 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.485333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.485386 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.485454 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:37.485967 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.486541 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.487705 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.488117 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.488248 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.488306 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.488482 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.488564 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:27:37.488770 21262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.485168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:38115 (local address 127.11.248.2:42583)
0811 07:27:37.485322 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.485327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.485499 (+ 172us) server_negotiation.cc:407] Connection header received
0811 07:27:37.485585 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.485588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.485637 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.485713 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:37.486071 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.486569 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.487742 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.488124 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.488261 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.488314 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.488533 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.488639 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:27:37.488798 21273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.484537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:44693 (local address 127.11.248.1:55811)
0811 07:27:37.484974 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.484991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.485154 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.485634 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.485637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.485657 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:37.485840 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.485848 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.486662 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.486668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.487577 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.487586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.488242 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.488246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.488345 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.488369 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.488447 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.488541 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":22,"thread_start_us":133,"threads_started":1}
I20260811 07:27:37.489023 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.485088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:42583 (local address 127.11.248.1:38115)
0811 07:27:37.485402 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.485418 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.485509 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.485732 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.485734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.485747 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:37.485952 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.485961 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.486721 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.486724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.487584 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.487593 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.488267 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.488270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.488385 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.488403 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.488500 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.488564 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":73,"thread_start_us":84,"threads_started":1}
I20260811 07:27:37.489606 21031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f773400296944f11a6e61afea1d16012" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366" is_pre_election: true
I20260811 07:27:37.490013 21031 raft_consensus.cc:2454] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 0.
I20260811 07:27:37.490003 21184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f773400296944f11a6e61afea1d16012" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" is_pre_election: true
I20260811 07:27:37.490294 21184 raft_consensus.cc:2454] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 0.
I20260811 07:27:37.490581 20807 leader_election.cc:302] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:37.490921 21271 raft_consensus.cc:2781] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:37.491019 21271 raft_consensus.cc:482] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:37.491050 21271 raft_consensus.cc:3037] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:37.492293 21271 raft_consensus.cc:504] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.492651 21271 leader_election.cc:288] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 election: Requested vote from peers 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693), c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:37.493177 21184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f773400296944f11a6e61afea1d16012" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f95fb1a510b4ce2a503618b87b0cca4"
I20260811 07:27:37.493181 21031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f773400296944f11a6e61afea1d16012" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366"
I20260811 07:27:37.493319 21184 raft_consensus.cc:3037] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:37.493319 21031 raft_consensus.cc:3037] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:37.494735 21031 raft_consensus.cc:2454] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 1.
I20260811 07:27:37.495090 20807 leader_election.cc:302] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:37.495244 21184 raft_consensus.cc:2454] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 1.
I20260811 07:27:37.495301 21271 raft_consensus.cc:2781] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:37.495564 21271 raft_consensus.cc:686] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 1 LEADER]: Becoming Leader. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Running, Role: LEADER
I20260811 07:27:37.495908 21271 consensus_queue.cc:237] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } }
I20260811 07:27:37.499374 20713 catalog_manager.cc:5495] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b reported cstate change: term changed from 0 to 1, leader changed from <none> to 492fc47b0850475893d7cf300b75568b (127.11.248.1). New cstate: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } health_report { overall_health: HEALTHY } } }
I20260811 07:27:37.521427 21261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.516718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46478 (local address 127.11.248.1:39795)
0811 07:27:37.516924 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.516928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.516944 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:37.517080 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.517082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.517140 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.517233 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:37.517560 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.518105 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.519323 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.519542 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.519684 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.520066 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:37.520881 (+ 815us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:37.520992 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.521148 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.521244 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:27:37.527906 21031 raft_consensus.cc:1261] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Refusing update from remote peer 492fc47b0850475893d7cf300b75568b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:37.527981 21184 raft_consensus.cc:1261] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Refusing update from remote peer 492fc47b0850475893d7cf300b75568b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:37.528692 21271 consensus_queue.cc:1035] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:37.529047 21275 consensus_queue.cc:1035] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:37.536923 21280 mvcc.cc:205] Tried to move back new op lower bound from 7317230622825299968 to 7317230622705741824. Current Snapshot: MvccSnapshot[applied={T|T < 7317230622825299968}]
I20260811 07:27:37.538029 21279 mvcc.cc:205] Tried to move back new op lower bound from 7317230622825299968 to 7317230622705741824. Current Snapshot: MvccSnapshot[applied={T|T < 7317230622825299968}]
I20260811 07:27:37.546525 20712 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:37.546715 20712 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:37.549526 20712 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Sending DeleteTablet for 3 replicas of tablet f773400296944f11a6e61afea1d16012
I20260811 07:27:37.550572 20861 tablet_service.cc:1514] Processing DeleteTablet for tablet f773400296944f11a6e61afea1d16012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:37 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:46468
I20260811 07:27:37.550782 21013 tablet_service.cc:1514] Processing DeleteTablet for tablet f773400296944f11a6e61afea1d16012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:37 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:34140
I20260811 07:27:37.551199 21162 tablet_service.cc:1514] Processing DeleteTablet for tablet f773400296944f11a6e61afea1d16012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:37 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:59722
I20260811 07:27:37.551317 20713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:27:37.551704 21289 tablet_replica.cc:330] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: stopping tablet replica
I20260811 07:27:37.551733 21288 tablet_replica.cc:330] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: stopping tablet replica
W20260811 07:27:37.551805 20713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:37.552086 21288 raft_consensus.cc:2229] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:37.552086 21289 raft_consensus.cc:2229] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:37.552518 21288 raft_consensus.cc:2258] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:37.552524 21289 raft_consensus.cc:2258] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:37.552987 21290 tablet_replica.cc:330] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: stopping tablet replica
I20260811 07:27:37.553539 21290 raft_consensus.cc:2229] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:37.553905 21290 raft_consensus.cc:2258] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:37.554769 21288 ts_tablet_manager.cc:1905] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:37.555444 21290 ts_tablet_manager.cc:1905] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:37.557300 20861 tablet_service.cc:1467] Processing CreateTablet for tablet 080997d4b55940858a0861efa7f7ed7f (DEFAULT_TABLE table=test-table [id=20acef735a4c481382082a533f0dd7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:37.557300 21013 tablet_service.cc:1467] Processing CreateTablet for tablet 080997d4b55940858a0861efa7f7ed7f (DEFAULT_TABLE table=test-table [id=20acef735a4c481382082a533f0dd7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:37.557447 21289 ts_tablet_manager.cc:1905] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:37.557581 21013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080997d4b55940858a0861efa7f7ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.557581 20861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080997d4b55940858a0861efa7f7ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.560107 21264 tablet_bootstrap.cc:492] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Bootstrap starting.
I20260811 07:27:37.560480 21263 tablet_bootstrap.cc:492] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Bootstrap starting.
I20260811 07:27:37.561175 21264 tablet_bootstrap.cc:654] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.561524 21263 tablet_bootstrap.cc:654] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.561976 21289 ts_tablet_manager.cc:1918] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:37.562085 21289 log.cc:1196] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/f773400296944f11a6e61afea1d16012
I20260811 07:27:37.562430 21289 ts_tablet_manager.cc:1939] T f773400296944f11a6e61afea1d16012 P c55d663f0c494cc6966643c4e9748366: Deleting consensus metadata
I20260811 07:27:37.562825 21264 tablet_bootstrap.cc:492] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: No bootstrap required, opened a new log
I20260811 07:27:37.562912 21264 ts_tablet_manager.cc:1397] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:37.563367 21162 tablet_service.cc:1467] Processing CreateTablet for tablet 080997d4b55940858a0861efa7f7ed7f (DEFAULT_TABLE table=test-table [id=20acef735a4c481382082a533f0dd7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:37.563373 21264 raft_consensus.cc:348] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.563488 21264 raft_consensus.cc:374] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.563521 21264 raft_consensus.cc:729] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.563669 21162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080997d4b55940858a0861efa7f7ed7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.563649 21264 consensus_queue.cc:260] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.563912 21264 ts_tablet_manager.cc:1428] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:37.565107 20695 catalog_manager.cc:4841] TS c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583): tablet f773400296944f11a6e61afea1d16012 (table test-table [id=63e6b525dbb448f0bc76e045ecbe7b6a]) successfully deleted
I20260811 07:27:37.566654 21266 tablet_bootstrap.cc:492] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Bootstrap starting.
I20260811 07:27:37.567062 21288 ts_tablet_manager.cc:1918] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:37.567169 21288 log.cc:1196] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/f773400296944f11a6e61afea1d16012
I20260811 07:27:37.567493 21288 ts_tablet_manager.cc:1939] T f773400296944f11a6e61afea1d16012 P 492fc47b0850475893d7cf300b75568b: Deleting consensus metadata
I20260811 07:27:37.567777 21266 tablet_bootstrap.cc:654] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.568919 20698 catalog_manager.cc:4841] TS 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795): tablet f773400296944f11a6e61afea1d16012 (table test-table [id=63e6b525dbb448f0bc76e045ecbe7b6a]) successfully deleted
I20260811 07:27:37.569252 21263 tablet_bootstrap.cc:492] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: No bootstrap required, opened a new log
I20260811 07:27:37.569357 21263 ts_tablet_manager.cc:1397] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260811 07:27:37.569911 21266 tablet_bootstrap.cc:492] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: No bootstrap required, opened a new log
I20260811 07:27:37.569820 21263 raft_consensus.cc:348] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.569994 21263 raft_consensus.cc:374] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.570037 21263 raft_consensus.cc:729] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55d663f0c494cc6966643c4e9748366, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.570043 21266 ts_tablet_manager.cc:1397] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:37.570168 21263 consensus_queue.cc:260] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.570436 21263 ts_tablet_manager.cc:1428] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:27:37.570593 21266 raft_consensus.cc:348] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.570717 21266 raft_consensus.cc:374] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.570753 21266 raft_consensus.cc:729] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.571133 21266 consensus_queue.cc:260] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.572935 21266 ts_tablet_manager.cc:1428] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:37.573529 21290 ts_tablet_manager.cc:1918] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:37.573693 21290 log.cc:1196] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/f773400296944f11a6e61afea1d16012
I20260811 07:27:37.574060 21290 ts_tablet_manager.cc:1939] T f773400296944f11a6e61afea1d16012 P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting consensus metadata
I20260811 07:27:37.575531 20695 catalog_manager.cc:4841] TS 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693): tablet f773400296944f11a6e61afea1d16012 (table test-table [id=63e6b525dbb448f0bc76e045ecbe7b6a]) successfully deleted
I20260811 07:27:37.844358 21283 raft_consensus.cc:482] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:37.844558 21283 raft_consensus.cc:504] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.845124 21283 leader_election.cc:288] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583), 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693)
I20260811 07:27:37.845709 21031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080997d4b55940858a0861efa7f7ed7f" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366" is_pre_election: true
I20260811 07:27:37.845757 21184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080997d4b55940858a0861efa7f7ed7f" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" is_pre_election: true
I20260811 07:27:37.845920 21184 raft_consensus.cc:2454] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 0.
I20260811 07:27:37.845939 21031 raft_consensus.cc:2454] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 0.
I20260811 07:27:37.846310 20807 leader_election.cc:302] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:37.846570 21283 raft_consensus.cc:2781] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:37.846627 21283 raft_consensus.cc:482] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:37.846654 21283 raft_consensus.cc:3037] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:37.847765 21283 raft_consensus.cc:504] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.848115 21283 leader_election.cc:288] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 election: Requested vote from peers c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583), 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693)
I20260811 07:27:37.848552 21031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080997d4b55940858a0861efa7f7ed7f" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366"
I20260811 07:27:37.848598 21184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080997d4b55940858a0861efa7f7ed7f" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f95fb1a510b4ce2a503618b87b0cca4"
I20260811 07:27:37.848694 21031 raft_consensus.cc:3037] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:37.848759 21184 raft_consensus.cc:3037] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:37.849709 21031 raft_consensus.cc:2454] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 1.
I20260811 07:27:37.849786 21184 raft_consensus.cc:2454] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 1.
I20260811 07:27:37.849997 20807 leader_election.cc:302] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:37.850193 21283 raft_consensus.cc:2781] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:37.850313 21283 raft_consensus.cc:686] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 1 LEADER]: Becoming Leader. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Running, Role: LEADER
I20260811 07:27:37.850479 21283 consensus_queue.cc:237] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.852137 20712 catalog_manager.cc:5495] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b reported cstate change: term changed from 0 to 1, leader changed from <none> to 492fc47b0850475893d7cf300b75568b (127.11.248.1). New cstate: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:27:37 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433256, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.62@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:37.971494 21302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.962701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39925 (local address 127.0.0.1:39656)
0811 07:27:37.963036 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:37.963061 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:37.963164 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:37.963421 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:37.963424 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:37.963814 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:37.963918 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.963925 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.964670 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.964672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.965316 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:37.965346 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.965789 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.965792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:37.965858 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.966406 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:37.966418 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:37.967843 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:37.969693 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:37.969704 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:37.969709 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:37.970000 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:37.970406 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:37.970409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:37.970410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:37.970502 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:37.970930 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:37.970962 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:37.971077 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 07:27:37.971177 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:27:37.971312 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":103,"threads_started":1}
I20260811 07:27:37.971709 21303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:37.962785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39656 (local address 127.11.248.62:39925)
0811 07:27:37.963120 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:37.963127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:37.963143 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:37.963254 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:37.963256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:37.963297 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:37.963400 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:37.964026 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.964573 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.965453 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:37.965673 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:37.965753 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:37.967975 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:37.967978 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:37.967980 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:37.968001 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:37.969554 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.970130 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.970133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.970134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.970225 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:37.970600 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:37.970603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:37.970604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:37.970810 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:37.970914 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:37.971278 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 07:27:37.971456 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":187,"threads_started":1}
I20260811 07:27:37.976227 20712 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:39656:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:27:37.977133 20712 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:37.982607 20861 tablet_service.cc:1467] Processing CreateTablet for tablet 7d23b4eb023348a4b21b5e1880bdfb38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6d9a6e29576447759b12af945fd735dc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:37.982735 21013 tablet_service.cc:1467] Processing CreateTablet for tablet 7d23b4eb023348a4b21b5e1880bdfb38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6d9a6e29576447759b12af945fd735dc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:37.982825 21162 tablet_service.cc:1467] Processing CreateTablet for tablet 7d23b4eb023348a4b21b5e1880bdfb38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6d9a6e29576447759b12af945fd735dc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:27:37.983079 20861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d23b4eb023348a4b21b5e1880bdfb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.983079 21013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d23b4eb023348a4b21b5e1880bdfb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.983278 21162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d23b4eb023348a4b21b5e1880bdfb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:37.985927 21266 tablet_bootstrap.cc:492] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: Bootstrap starting.
I20260811 07:27:37.985942 21264 tablet_bootstrap.cc:492] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: Bootstrap starting.
I20260811 07:27:37.986725 21264 tablet_bootstrap.cc:654] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.986838 21266 tablet_bootstrap.cc:654] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.987308 21263 tablet_bootstrap.cc:492] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: Bootstrap starting.
I20260811 07:27:37.988114 21266 tablet_bootstrap.cc:492] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: No bootstrap required, opened a new log
I20260811 07:27:37.988221 21266 ts_tablet_manager.cc:1397] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:37.988271 21263 tablet_bootstrap.cc:654] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:37.988741 21266 raft_consensus.cc:348] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.988905 21266 raft_consensus.cc:374] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.988969 21266 raft_consensus.cc:729] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.989110 21266 consensus_queue.cc:260] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.989279 21264 tablet_bootstrap.cc:492] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: No bootstrap required, opened a new log
I20260811 07:27:37.989392 21264 ts_tablet_manager.cc:1397] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:37.989595 21266 ts_tablet_manager.cc:1428] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:27:37.989567 21272 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:37.989758 21272 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:37.989842 21264 raft_consensus.cc:348] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.989948 21264 raft_consensus.cc:374] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.990008 21264 raft_consensus.cc:729] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.990131 21264 consensus_queue.cc:260] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.990437 21264 ts_tablet_manager.cc:1428] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:37.990618 21263 tablet_bootstrap.cc:492] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: No bootstrap required, opened a new log
I20260811 07:27:37.990715 21263 ts_tablet_manager.cc:1397] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:37.991173 21263 raft_consensus.cc:348] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.991299 21263 raft_consensus.cc:374] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:37.991340 21263 raft_consensus.cc:729] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55d663f0c494cc6966643c4e9748366, State: Initialized, Role: FOLLOWER
I20260811 07:27:37.991305 21283 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:37.991422 21283 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:37.991469 21263 consensus_queue.cc:260] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:37.991755 21263 ts_tablet_manager.cc:1428] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:37.991842 21270 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:37.991990 21270 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:38.010882 21283 raft_consensus.cc:482] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:38.011024 21283 raft_consensus.cc:504] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.011478 21283 leader_election.cc:288] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583), 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693)
I20260811 07:27:38.011968 21031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d23b4eb023348a4b21b5e1880bdfb38" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366" is_pre_election: true
I20260811 07:27:38.012040 21184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d23b4eb023348a4b21b5e1880bdfb38" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" is_pre_election: true
I20260811 07:27:38.012151 21031 raft_consensus.cc:2454] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 0.
I20260811 07:27:38.012234 21184 raft_consensus.cc:2454] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 0.
I20260811 07:27:38.012547 20807 leader_election.cc:302] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:38.012782 21283 raft_consensus.cc:2781] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:38.012895 21283 raft_consensus.cc:482] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:38.012969 21283 raft_consensus.cc:3037] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.014211 21283 raft_consensus.cc:504] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.014591 21283 leader_election.cc:288] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 election: Requested vote from peers c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583), 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693)
I20260811 07:27:38.015023 21031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d23b4eb023348a4b21b5e1880bdfb38" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366"
I20260811 07:27:38.015091 21184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d23b4eb023348a4b21b5e1880bdfb38" candidate_uuid: "492fc47b0850475893d7cf300b75568b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f95fb1a510b4ce2a503618b87b0cca4"
I20260811 07:27:38.015185 21031 raft_consensus.cc:3037] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.015254 21184 raft_consensus.cc:3037] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.016144 21031 raft_consensus.cc:2454] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 1.
I20260811 07:27:38.016216 21184 raft_consensus.cc:2454] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 492fc47b0850475893d7cf300b75568b in term 1.
I20260811 07:27:38.016520 20807 leader_election.cc:302] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:38.016754 21283 raft_consensus.cc:2781] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:38.016885 21283 raft_consensus.cc:686] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [term 1 LEADER]: Becoming Leader. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Running, Role: LEADER
I20260811 07:27:38.017043 21283 consensus_queue.cc:237] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.017796 21275 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: TxnStatusTablet state changed. Reason: New leader 492fc47b0850475893d7cf300b75568b. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.017928 21275 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:38.018157 21308 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:27:38.018339 21308 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:27:38.018932 20713 catalog_manager.cc:5495] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b reported cstate change: term changed from 0 to 1, leader changed from <none> to 492fc47b0850475893d7cf300b75568b (127.11.248.1). New cstate: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } health_report { overall_health: UNKNOWN } } }
I20260811 07:27:38.032491 21302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.028365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:39795 (local address 127.0.0.1:46488)
0811 07:27:38.028511 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.028525 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:38.028612 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:38.029351 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:38.029354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:38.029360 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:38.029459 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.029464 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.030511 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.030514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.031123 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.031132 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.031704 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.031707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.031784 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.031832 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.032141 (+ 309us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.032185 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:27:38.032263 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 07:27:38.032345 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 07:27:38.032533 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.028755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46488 (local address 127.11.248.1:39795)
0811 07:27:38.029105 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.029110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.029125 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:38.029172 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.029175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.029225 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.029317 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:38.029567 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.030366 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.031239 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.031588 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.031691 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.031965 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.032054 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.032126 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.032299 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.032357 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":190,"threads_started":1}
I20260811 07:27:38.035277 21184 raft_consensus.cc:1261] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Refusing update from remote peer 492fc47b0850475893d7cf300b75568b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.035334 21031 raft_consensus.cc:1261] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Refusing update from remote peer 492fc47b0850475893d7cf300b75568b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.035781 21275 consensus_queue.cc:1035] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.036012 21283 consensus_queue.cc:1035] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.037396 21270 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: TxnStatusTablet state changed. Reason: New leader 492fc47b0850475893d7cf300b75568b. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.037516 21270 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:38.038654 21272 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: TxnStatusTablet state changed. Reason: New leader 492fc47b0850475893d7cf300b75568b. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.038789 21272 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:38.040458 21275 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.040597 21275 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:38.040736 21278 mvcc.cc:205] Tried to move back new op lower bound from 7317230624907927552 to 7317230624839483392. Current Snapshot: MvccSnapshot[applied={T|T < 7317230624907927552}]
I20260811 07:27:38.041728 21283 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.041834 21283 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 492fc47b0850475893d7cf300b75568b: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:27:38.042302 21272 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.042423 21272 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P 6f95fb1a510b4ce2a503618b87b0cca4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:38.042738 21270 tablet_replica.cc:439] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "492fc47b0850475893d7cf300b75568b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } } }
I20260811 07:27:38.042852 21270 tablet_replica.cc:442] T 7d23b4eb023348a4b21b5e1880bdfb38 P c55d663f0c494cc6966643c4e9748366: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:27:38.059633 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.055624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:34791 (local address 127.11.248.1:39795)
0811 07:27:38.055754 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.055759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.055975 (+ 216us) server_negotiation.cc:407] Connection header received
0811 07:27:38.056087 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.056090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.056142 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.056207 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:38.056482 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.057057 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.058444 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.058651 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.058732 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.059177 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.059243 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.059296 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.059450 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.059500 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:27:38.059679 21321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.055561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:39795 (local address 127.11.248.1:34791)
0811 07:27:38.055855 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.055871 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:38.055986 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:38.056243 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:38.056246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:38.056254 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:38.056371 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.056377 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.057159 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.057163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.058307 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.058320 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.058764 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.058768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.058979 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.059038 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.059325 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.059331 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:27:38.059406 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:27:38.059491 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":103,"threads_started":1}
I20260811 07:27:38.066656 21031 raft_consensus.cc:1261] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Refusing update from remote peer 492fc47b0850475893d7cf300b75568b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.066671 21184 raft_consensus.cc:1261] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Refusing update from remote peer 492fc47b0850475893d7cf300b75568b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.067104 21283 consensus_queue.cc:1035] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.067397 21283 consensus_queue.cc:1035] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.109329 20712 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:38.109583 20712 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:38.111783 20712 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Sending DeleteTablet for 3 replicas of tablet 080997d4b55940858a0861efa7f7ed7f
I20260811 07:27:38.112639 21162 tablet_service.cc:1514] Processing DeleteTablet for tablet 080997d4b55940858a0861efa7f7ed7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:59722
I20260811 07:27:38.112869 21013 tablet_service.cc:1514] Processing DeleteTablet for tablet 080997d4b55940858a0861efa7f7ed7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:34140
I20260811 07:27:38.113261 20860 tablet_service.cc:1514] Processing DeleteTablet for tablet 080997d4b55940858a0861efa7f7ed7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:46468
I20260811 07:27:38.113649 21329 tablet_replica.cc:330] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: stopping tablet replica
I20260811 07:27:38.113687 21327 tablet_replica.cc:330] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: stopping tablet replica
I20260811 07:27:38.113878 21329 raft_consensus.cc:2229] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:38.114154 21329 raft_consensus.cc:2258] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.115015 21329 ts_tablet_manager.cc:1905] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.115319 21327 raft_consensus.cc:2229] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:38.115509 21327 raft_consensus.cc:2258] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.116400 21327 ts_tablet_manager.cc:1905] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.118741 21329 ts_tablet_manager.cc:1918] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:38.118916 21329 log.cc:1196] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/080997d4b55940858a0861efa7f7ed7f
I20260811 07:27:38.119095 21328 tablet_replica.cc:330] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: stopping tablet replica
I20260811 07:27:38.119256 21328 raft_consensus.cc:2229] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:38.119400 21328 raft_consensus.cc:2258] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.119534 21329 ts_tablet_manager.cc:1939] T 080997d4b55940858a0861efa7f7ed7f P 492fc47b0850475893d7cf300b75568b: Deleting consensus metadata
I20260811 07:27:38.120380 21328 ts_tablet_manager.cc:1905] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.120579 20698 catalog_manager.cc:4841] TS 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795): tablet 080997d4b55940858a0861efa7f7ed7f (table test-table [id=20acef735a4c481382082a533f0dd7b3]) successfully deleted
I20260811 07:27:38.120002 21327 ts_tablet_manager.cc:1918] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:38.121007 21327 log.cc:1196] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/080997d4b55940858a0861efa7f7ed7f
I20260811 07:27:38.121379 21327 ts_tablet_manager.cc:1939] T 080997d4b55940858a0861efa7f7ed7f P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting consensus metadata
I20260811 07:27:38.122323 20695 catalog_manager.cc:4841] TS 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693): tablet 080997d4b55940858a0861efa7f7ed7f (table test-table [id=20acef735a4c481382082a533f0dd7b3]) successfully deleted
I20260811 07:27:38.124331 21328 ts_tablet_manager.cc:1918] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:38.124431 21328 log.cc:1196] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/080997d4b55940858a0861efa7f7ed7f
I20260811 07:27:38.124789 21328 ts_tablet_manager.cc:1939] T 080997d4b55940858a0861efa7f7ed7f P c55d663f0c494cc6966643c4e9748366: Deleting consensus metadata
I20260811 07:27:38.125564 20695 catalog_manager.cc:4841] TS c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583): tablet 080997d4b55940858a0861efa7f7ed7f (table test-table [id=20acef735a4c481382082a533f0dd7b3]) successfully deleted
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[20662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:27:38.151503 21303 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:38.143385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39658 (local address 127.11.248.62:39925)
0811 07:27:38.143566 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.143572 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.143724 (+ 152us) server_negotiation.cc:407] Connection header received
0811 07:27:38.143871 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.143875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.143938 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.144044 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:38.144924 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.145727 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.146651 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.147060 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.147196 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.151357 (+ 4161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39658: BlockingRecv error: recv got EOF from 127.0.0.1:39658 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[20662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM
I20260811 07:27:38.164686 21303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.153293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39660 (local address 127.11.248.62:39925)
0811 07:27:38.153417 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.153422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.153677 (+ 255us) server_negotiation.cc:407] Connection header received
0811 07:27:38.153793 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.153797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.153868 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.153966 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:38.154773 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.155637 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.156990 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.157351 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.157472 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.160700 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:38.160704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:38.160707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:38.160739 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:38.162731 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:38.163319 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:38.163323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:38.163325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:38.163421 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:38.163732 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:38.163735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:38.163736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:38.163961 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:38.164095 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.164380 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.164514 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:27:38.168655 20712 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:27:38.169255 20712 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:38.175055 20860 tablet_service.cc:1467] Processing CreateTablet for tablet 7d32089ca8a8414d8419f52dba9390dd (DEFAULT_TABLE table=test-table [id=fa1d580677214fa195f3dfc734e0aea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:38.175269 21013 tablet_service.cc:1467] Processing CreateTablet for tablet 7d32089ca8a8414d8419f52dba9390dd (DEFAULT_TABLE table=test-table [id=fa1d580677214fa195f3dfc734e0aea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:38.175295 21162 tablet_service.cc:1467] Processing CreateTablet for tablet 7d32089ca8a8414d8419f52dba9390dd (DEFAULT_TABLE table=test-table [id=fa1d580677214fa195f3dfc734e0aea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:38.175432 20860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d32089ca8a8414d8419f52dba9390dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:38.175555 21013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d32089ca8a8414d8419f52dba9390dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:38.175628 21162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d32089ca8a8414d8419f52dba9390dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:38.178192 21263 tablet_bootstrap.cc:492] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Bootstrap starting.
I20260811 07:27:38.178853 21266 tablet_bootstrap.cc:492] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Bootstrap starting.
I20260811 07:27:38.179203 21263 tablet_bootstrap.cc:654] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:38.179759 21266 tablet_bootstrap.cc:654] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:38.180734 21263 tablet_bootstrap.cc:492] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: No bootstrap required, opened a new log
I20260811 07:27:38.180876 21263 ts_tablet_manager.cc:1397] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:38.180913 21264 tablet_bootstrap.cc:492] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Bootstrap starting.
I20260811 07:27:38.181378 21263 raft_consensus.cc:348] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.181499 21263 raft_consensus.cc:374] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:38.181538 21263 raft_consensus.cc:729] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55d663f0c494cc6966643c4e9748366, State: Initialized, Role: FOLLOWER
I20260811 07:27:38.181651 21266 tablet_bootstrap.cc:492] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: No bootstrap required, opened a new log
I20260811 07:27:38.181664 21263 consensus_queue.cc:260] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.181730 21266 ts_tablet_manager.cc:1397] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:38.181821 21264 tablet_bootstrap.cc:654] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:38.182191 21266 raft_consensus.cc:348] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.182297 21266 raft_consensus.cc:374] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:38.182330 21266 raft_consensus.cc:729] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Initialized, Role: FOLLOWER
I20260811 07:27:38.182457 21266 consensus_queue.cc:260] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.182787 21266 ts_tablet_manager.cc:1428] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:38.182832 21263 ts_tablet_manager.cc:1428] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 07:27:38.183820 21264 tablet_bootstrap.cc:492] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: No bootstrap required, opened a new log
I20260811 07:27:38.183913 21264 ts_tablet_manager.cc:1397] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:38.184407 21264 raft_consensus.cc:348] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.184538 21264 raft_consensus.cc:374] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:38.184584 21264 raft_consensus.cc:729] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Initialized, Role: FOLLOWER
I20260811 07:27:38.184712 21264 consensus_queue.cc:260] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.185060 21264 ts_tablet_manager.cc:1428] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:38.215309 21272 raft_consensus.cc:482] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:38.215499 21272 raft_consensus.cc:504] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.216621 21272 leader_election.cc:288] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795), c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:38.221880 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.217110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:50763 (local address 127.11.248.1:39795)
0811 07:27:38.217273 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.217280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.217534 (+ 254us) server_negotiation.cc:407] Connection header received
0811 07:27:38.217735 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.217741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.217804 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.217883 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:38.218340 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.219181 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.220693 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.221310 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.221494 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.221556 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.221667 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.221739 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:27:38.221905 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.217020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:39795 (local address 127.11.248.3:50763)
0811 07:27:38.217439 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.217457 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:38.217590 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:38.217923 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:38.217929 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:38.218008 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:38.218201 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.218208 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.219331 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.219335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.220562 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.220572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.221446 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.221450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.221545 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.221574 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:27:38.221654 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:27:38.221732 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":32,"thread_start_us":87,"threads_started":1}
I20260811 07:27:38.222460 21345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.217018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:42583 (local address 127.11.248.3:50159)
0811 07:27:38.217561 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.217576 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:38.217712 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:38.218066 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:38.218069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:38.218085 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:27:38.218715 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.218726 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.219987 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.219990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.220987 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.220999 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.221973 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.221979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.222107 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.222132 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:27:38.222205 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 07:27:38.222275 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":49,"thread_start_us":99,"threads_started":1}
I20260811 07:27:38.222604 21348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.217139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:50159 (local address 127.11.248.2:42583)
0811 07:27:38.217469 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.217482 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.217670 (+ 188us) server_negotiation.cc:407] Connection header received
0811 07:27:38.217809 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.217818 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.217902 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.217997 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:27:38.218913 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.219799 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.221138 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.221804 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.221993 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.222049 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.222355 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.222437 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":123,"threads_started":1}
I20260811 07:27:38.222745 20881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32089ca8a8414d8419f52dba9390dd" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "492fc47b0850475893d7cf300b75568b" is_pre_election: true
I20260811 07:27:38.223039 20881 raft_consensus.cc:2454] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 0.
I20260811 07:27:38.223541 21111 leader_election.cc:302] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, 6f95fb1a510b4ce2a503618b87b0cca4; no voters:
I20260811 07:27:38.223667 21029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32089ca8a8414d8419f52dba9390dd" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366" is_pre_election: true
I20260811 07:27:38.223855 21029 raft_consensus.cc:2454] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 0.
I20260811 07:27:38.223881 21272 raft_consensus.cc:2781] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:38.223946 21272 raft_consensus.cc:482] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:38.224009 21272 raft_consensus.cc:3037] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.225281 21272 raft_consensus.cc:504] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.225790 21272 leader_election.cc:288] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 election: Requested vote from peers 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795), c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:38.226272 21029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32089ca8a8414d8419f52dba9390dd" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366"
I20260811 07:27:38.226240 20881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d32089ca8a8414d8419f52dba9390dd" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "492fc47b0850475893d7cf300b75568b"
I20260811 07:27:38.226439 20881 raft_consensus.cc:3037] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.226434 21029 raft_consensus.cc:3037] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.227643 20881 raft_consensus.cc:2454] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 1.
I20260811 07:27:38.227720 21029 raft_consensus.cc:2454] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 1.
I20260811 07:27:38.228145 21109 leader_election.cc:302] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f95fb1a510b4ce2a503618b87b0cca4, c55d663f0c494cc6966643c4e9748366; no voters:
I20260811 07:27:38.228364 21272 raft_consensus.cc:2781] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:38.228619 21272 raft_consensus.cc:686] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 LEADER]: Becoming Leader. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Running, Role: LEADER
I20260811 07:27:38.228953 21272 consensus_queue.cc:237] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.231587 20711 catalog_manager.cc:5495] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3). New cstate: current_term: 1 leader_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } health_report { overall_health: HEALTHY } } }
I20260811 07:27:38.256273 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.251792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59734 (local address 127.11.248.3:44693)
0811 07:27:38.252281 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.252293 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.252313 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:27:38.252415 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.252419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.252499 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.252621 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:38.253019 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.253561 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.254538 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.254793 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.254879 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.255128 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.255717 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.255814 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.255972 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.256032 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":221,"threads_started":1}
I20260811 07:27:38.259310 21029 raft_consensus.cc:1261] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Refusing update from remote peer 6f95fb1a510b4ce2a503618b87b0cca4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.259577 20881 raft_consensus.cc:1261] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Refusing update from remote peer 6f95fb1a510b4ce2a503618b87b0cca4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.259891 21272 consensus_queue.cc:1035] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.260211 21349 consensus_queue.cc:1035] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.273454 20711 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:38.273619 20711 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:38.275947 20711 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Sending DeleteTablet for 3 replicas of tablet 7d32089ca8a8414d8419f52dba9390dd
I20260811 07:27:38.276750 20860 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32089ca8a8414d8419f52dba9390dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:46468
I20260811 07:27:38.277089 21329 tablet_replica.cc:330] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: stopping tablet replica
I20260811 07:27:38.277120 21162 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32089ca8a8414d8419f52dba9390dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:59722
I20260811 07:27:38.277182 21013 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d32089ca8a8414d8419f52dba9390dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:34140
I20260811 07:27:38.277261 21329 raft_consensus.cc:2229] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:38.277391 21328 tablet_replica.cc:330] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: stopping tablet replica
I20260811 07:27:38.277417 21329 raft_consensus.cc:2258] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.277537 21328 raft_consensus.cc:2229] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:38.277606 21327 tablet_replica.cc:330] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: stopping tablet replica
I20260811 07:27:38.277695 21328 raft_consensus.cc:2258] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.277719 21327 raft_consensus.cc:2229] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:38.278054 21327 raft_consensus.cc:2258] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.278316 21329 ts_tablet_manager.cc:1905] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.279328 20711 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:27:38.279512 21327 ts_tablet_manager.cc:1905] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:27:38.279848 20711 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:27:38.281213 21329 ts_tablet_manager.cc:1918] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:38.281296 21329 log.cc:1196] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/7d32089ca8a8414d8419f52dba9390dd
I20260811 07:27:38.281584 21329 ts_tablet_manager.cc:1939] T 7d32089ca8a8414d8419f52dba9390dd P 492fc47b0850475893d7cf300b75568b: Deleting consensus metadata
I20260811 07:27:38.282155 21327 ts_tablet_manager.cc:1918] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:38.282248 21327 log.cc:1196] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/7d32089ca8a8414d8419f52dba9390dd
I20260811 07:27:38.282449 20698 catalog_manager.cc:4841] TS 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795): tablet 7d32089ca8a8414d8419f52dba9390dd (table test-table [id=fa1d580677214fa195f3dfc734e0aea8]) successfully deleted
I20260811 07:27:38.282516 21327 ts_tablet_manager.cc:1939] T 7d32089ca8a8414d8419f52dba9390dd P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting consensus metadata
I20260811 07:27:38.283382 21328 ts_tablet_manager.cc:1905] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.285459 20695 catalog_manager.cc:4841] TS 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693): tablet 7d32089ca8a8414d8419f52dba9390dd (table test-table [id=fa1d580677214fa195f3dfc734e0aea8]) successfully deleted
I20260811 07:27:38.285811 21162 tablet_service.cc:1467] Processing CreateTablet for tablet 8c6d4553edd44d2b89711e3e6b93d3aa (DEFAULT_TABLE table=test-table [id=a5951ef5c0344a519ca658611135c5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:38.285957 21013 tablet_service.cc:1467] Processing CreateTablet for tablet 8c6d4553edd44d2b89711e3e6b93d3aa (DEFAULT_TABLE table=test-table [id=a5951ef5c0344a519ca658611135c5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:38.286063 21328 ts_tablet_manager.cc:1918] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:27:38.286091 21162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c6d4553edd44d2b89711e3e6b93d3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:38.286140 21328 log.cc:1196] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/7d32089ca8a8414d8419f52dba9390dd
I20260811 07:27:38.286203 21013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c6d4553edd44d2b89711e3e6b93d3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:38.286427 21328 ts_tablet_manager.cc:1939] T 7d32089ca8a8414d8419f52dba9390dd P c55d663f0c494cc6966643c4e9748366: Deleting consensus metadata
I20260811 07:27:38.288515 21263 tablet_bootstrap.cc:492] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Bootstrap starting.
I20260811 07:27:38.288515 21266 tablet_bootstrap.cc:492] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Bootstrap starting.
I20260811 07:27:38.289603 21263 tablet_bootstrap.cc:654] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:38.289603 21266 tablet_bootstrap.cc:654] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:38.290602 20695 catalog_manager.cc:4841] TS c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583): tablet 7d32089ca8a8414d8419f52dba9390dd (table test-table [id=fa1d580677214fa195f3dfc734e0aea8]) successfully deleted
I20260811 07:27:38.291136 21266 tablet_bootstrap.cc:492] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: No bootstrap required, opened a new log
I20260811 07:27:38.291237 21266 ts_tablet_manager.cc:1397] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:38.291723 21263 tablet_bootstrap.cc:492] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: No bootstrap required, opened a new log
I20260811 07:27:38.291831 21263 ts_tablet_manager.cc:1397] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:38.291774 21266 raft_consensus.cc:348] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.291904 21266 raft_consensus.cc:374] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:38.291954 21266 raft_consensus.cc:729] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Initialized, Role: FOLLOWER
I20260811 07:27:38.292138 21266 consensus_queue.cc:260] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.292333 21263 raft_consensus.cc:348] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.292445 21263 raft_consensus.cc:374] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:38.292452 21266 ts_tablet_manager.cc:1428] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:27:38.292485 21263 raft_consensus.cc:729] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55d663f0c494cc6966643c4e9748366, State: Initialized, Role: FOLLOWER
I20260811 07:27:38.292619 21263 consensus_queue.cc:260] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.292958 21263 ts_tablet_manager.cc:1428] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:27:38.293738 20860 tablet_service.cc:1467] Processing CreateTablet for tablet 8c6d4553edd44d2b89711e3e6b93d3aa (DEFAULT_TABLE table=test-table [id=a5951ef5c0344a519ca658611135c5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:27:38.294065 20860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c6d4553edd44d2b89711e3e6b93d3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:38.296777 21264 tablet_bootstrap.cc:492] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: Bootstrap starting.
I20260811 07:27:38.297848 21264 tablet_bootstrap.cc:654] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:38.299139 21264 tablet_bootstrap.cc:492] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: No bootstrap required, opened a new log
I20260811 07:27:38.299225 21264 ts_tablet_manager.cc:1397] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 07:27:38.299650 21264 raft_consensus.cc:348] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.299762 21264 raft_consensus.cc:374] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:38.299782 21264 raft_consensus.cc:729] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 492fc47b0850475893d7cf300b75568b, State: Initialized, Role: FOLLOWER
I20260811 07:27:38.299961 21264 consensus_queue.cc:260] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.300263 21264 ts_tablet_manager.cc:1428] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:27:38.431350 21356 raft_consensus.cc:482] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:27:38.431524 21356 raft_consensus.cc:504] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.431988 21356 leader_election.cc:288] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795), c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:38.432559 20881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c6d4553edd44d2b89711e3e6b93d3aa" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "492fc47b0850475893d7cf300b75568b" is_pre_election: true
I20260811 07:27:38.432547 21029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c6d4553edd44d2b89711e3e6b93d3aa" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366" is_pre_election: true
I20260811 07:27:38.432745 21029 raft_consensus.cc:2454] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 0.
I20260811 07:27:38.432749 20881 raft_consensus.cc:2454] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 0.
I20260811 07:27:38.433123 21111 leader_election.cc:302] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, 6f95fb1a510b4ce2a503618b87b0cca4; no voters:
I20260811 07:27:38.433329 21356 raft_consensus.cc:2781] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:27:38.433401 21356 raft_consensus.cc:482] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:27:38.433441 21356 raft_consensus.cc:3037] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.434747 21356 raft_consensus.cc:504] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.435117 21356 leader_election.cc:288] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 election: Requested vote from peers 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795), c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583)
I20260811 07:27:38.435555 20881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c6d4553edd44d2b89711e3e6b93d3aa" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "492fc47b0850475893d7cf300b75568b"
I20260811 07:27:38.435726 20881 raft_consensus.cc:3037] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.435720 21029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c6d4553edd44d2b89711e3e6b93d3aa" candidate_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55d663f0c494cc6966643c4e9748366"
I20260811 07:27:38.435858 21029 raft_consensus.cc:3037] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:38.437067 21029 raft_consensus.cc:2454] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 1.
I20260811 07:27:38.437067 20881 raft_consensus.cc:2454] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f95fb1a510b4ce2a503618b87b0cca4 in term 1.
I20260811 07:27:38.437412 21111 leader_election.cc:302] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 492fc47b0850475893d7cf300b75568b, 6f95fb1a510b4ce2a503618b87b0cca4; no voters:
I20260811 07:27:38.437615 21356 raft_consensus.cc:2781] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:38.437717 21356 raft_consensus.cc:686] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 LEADER]: Becoming Leader. State: Replica: 6f95fb1a510b4ce2a503618b87b0cca4, State: Running, Role: LEADER
I20260811 07:27:38.437872 21356 consensus_queue.cc:237] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } }
I20260811 07:27:38.439960 20714 catalog_manager.cc:5495] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3). New cstate: current_term: 1 leader_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f95fb1a510b4ce2a503618b87b0cca4" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 44693 } health_report { overall_health: HEALTHY } } }
I20260811 07:27:38.474272 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.470854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:57223 (local address 127.11.248.1:39795)
0811 07:27:38.470997 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.471001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.471116 (+ 115us) server_negotiation.cc:407] Connection header received
0811 07:27:38.471256 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.471259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.471308 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.471392 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:38.471616 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.472131 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.473195 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.473422 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.473516 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.473848 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.473937 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.473995 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.474096 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.474151 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:27:38.474289 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.470695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:39795 (local address 127.11.248.3:57223)
0811 07:27:38.471030 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.471044 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:38.471147 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:38.471411 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:38.471412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:38.471420 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:38.471521 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.471525 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.472242 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.472245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.472987 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.472997 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.473536 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.473539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.473603 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.473654 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.474024 (+ 370us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.474031 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:27:38.474090 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 07:27:38.474168 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":140,"threads_started":1}
I20260811 07:27:38.480718 21029 raft_consensus.cc:1261] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Refusing update from remote peer 6f95fb1a510b4ce2a503618b87b0cca4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.480845 20881 raft_consensus.cc:1261] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Refusing update from remote peer 6f95fb1a510b4ce2a503618b87b0cca4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:27:38.481182 21349 consensus_queue.cc:1035] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55d663f0c494cc6966643c4e9748366" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.481395 21356 consensus_queue.cc:1035] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "492fc47b0850475893d7cf300b75568b" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 39795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:27:38.500753 21321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.496994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:44693 (local address 127.11.248.1:49011)
0811 07:27:38.497298 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.497317 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:38.497408 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:38.497687 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:38.497691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:38.497700 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:27:38.497855 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.497864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.498634 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.498637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.499269 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:38.499279 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.499708 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.499715 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:38.500011 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.500051 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.500414 (+ 363us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.500421 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:27:38.500515 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 07:27:38.500620 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260811 07:27:38.500758 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.497293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49011 (local address 127.11.248.3:44693)
0811 07:27:38.497422 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:38.497427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:38.497448 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:27:38.497489 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:38.497491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:38.497559 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:38.497638 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:27:38.497988 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.498507 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.499384 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:38.499603 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:38.499679 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:38.500198 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:27:38.500308 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:27:38.500388 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:38.500544 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 07:27:38.500628 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:27:38.523756 20711 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:38.523937 20711 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:27:38.526185 20711 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fdab615b3894a48850748f3861a18f0: Sending DeleteTablet for 3 replicas of tablet 8c6d4553edd44d2b89711e3e6b93d3aa
I20260811 07:27:38.526950 20860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c6d4553edd44d2b89711e3e6b93d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:46468
I20260811 07:27:38.526979 21162 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c6d4553edd44d2b89711e3e6b93d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:59722
I20260811 07:27:38.527091 21013 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c6d4553edd44d2b89711e3e6b93d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:27:38 UTC) from {username='oryx', principal='oryx/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:34140
I20260811 07:27:38.527200 21327 tablet_replica.cc:330] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: stopping tablet replica
I20260811 07:27:38.527215 21329 tablet_replica.cc:330] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: stopping tablet replica
I20260811 07:27:38.527271 21328 tablet_replica.cc:330] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: stopping tablet replica
I20260811 07:27:38.527354 21329 raft_consensus.cc:2229] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:38.527349 21327 raft_consensus.cc:2229] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:27:38.527384 21328 raft_consensus.cc:2229] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:27:38.527488 21329 raft_consensus.cc:2258] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.527503 21328 raft_consensus.cc:2258] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.527597 21327 raft_consensus.cc:2258] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:27:38.528177 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 20790
I20260811 07:27:38.528482 21329 ts_tablet_manager.cc:1905] T 8c6d4553edd44d2b89711e3e6b93d3aa P 492fc47b0850475893d7cf300b75568b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.528482 21328 ts_tablet_manager.cc:1905] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.531886 21328 ts_tablet_manager.cc:1918] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:38.531986 21328 log.cc:1196] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/8c6d4553edd44d2b89711e3e6b93d3aa
I20260811 07:27:38.531968 21327 ts_tablet_manager.cc:1905] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:27:38.532289 21328 ts_tablet_manager.cc:1939] T 8c6d4553edd44d2b89711e3e6b93d3aa P c55d663f0c494cc6966643c4e9748366: Deleting consensus metadata
I20260811 07:27:38.534402 21327 ts_tablet_manager.cc:1918] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:27:38.534483 21327 log.cc:1196] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/8c6d4553edd44d2b89711e3e6b93d3aa
I20260811 07:27:38.534775 21327 ts_tablet_manager.cc:1939] T 8c6d4553edd44d2b89711e3e6b93d3aa P 6f95fb1a510b4ce2a503618b87b0cca4: Deleting consensus metadata
I20260811 07:27:38.534858 20695 catalog_manager.cc:4841] TS c55d663f0c494cc6966643c4e9748366 (127.11.248.2:42583): tablet 8c6d4553edd44d2b89711e3e6b93d3aa (table test-table [id=a5951ef5c0344a519ca658611135c5b3]) successfully deleted
I20260811 07:27:38.535494 20695 catalog_manager.cc:4841] TS 6f95fb1a510b4ce2a503618b87b0cca4 (127.11.248.3:44693): tablet 8c6d4553edd44d2b89711e3e6b93d3aa (table test-table [id=a5951ef5c0344a519ca658611135c5b3]) successfully deleted
W20260811 07:27:38.541934 20698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:39795 (error 108)
I20260811 07:27:38.542286 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 20943
I20260811 07:27:38.545277 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:38.544634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:39795 (local address 127.0.0.1:46504)
0811 07:27:38.545020 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:38.545128 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:39795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":174,"threads_started":1}
W20260811 07:27:38.545656 20698 catalog_manager.cc:4584] TS 492fc47b0850475893d7cf300b75568b (127.11.248.1:39795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8c6d4553edd44d2b89711e3e6b93d3aa: Network error: Client connection negotiation failed: client connection to 127.11.248.1:39795: connect: Connection refused (error 111)
I20260811 07:27:38.550554 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 21092
I20260811 07:27:38.559906 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 20676
2026-08-11T07:27:38Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3674 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[21373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[21373](info): set up 2 sockets
Aug 11 07:27:38 dist-test-slave-77v9 krb5kdc[21373](info): commencing operation
krb5kdc: starting...
W20260811 07:27:39.674543 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:39 dist-test-slave-77v9 krb5kdc[21373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:39.816659 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46523
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:41363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:46523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:39.934099 21387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:39.934432 21387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:39.934533 21387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:39.938809 21387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:39.938903 21387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:39.938925 21387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:39.938944 21387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:39.938961 21387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:39.944777 21387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:46523
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:39.946069 21387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:39.947180 21387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:39.956032 21397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:39.956058 21393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:39.956058 21394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:39.956317 21387 server_base.cc:1034] running on GCE node
I20260811 07:27:39.956997 21387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:39.958170 21387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:39.959335 21387 hybrid_clock.cc:648] HybridClock initialized: now 1786433259959309 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T07:27:39Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1411 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:27:40 dist-test-slave-77v9 krb5kdc[21403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:27:40 dist-test-slave-77v9 krb5kdc[21403](info): set up 2 sockets
Aug 11 07:27:40 dist-test-slave-77v9 krb5kdc[21403](info): commencing operation
krb5kdc: starting...
W20260811 07:27:41.110980 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:27:41 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:27:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:27:41.253142 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41331
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:41331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:41.372754 21416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:41.373157 21416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:41.373242 21416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:41.377384 21416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:41.377481 21416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:41.377519 21416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:41.377558 21416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:41.377594 21416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:41.383096 21416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:41331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:41.384274 21416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:41.385385 21416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:41.394189 21425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:41.394199 21423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:41.394207 21422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:41.394456 21416 server_base.cc:1034] running on GCE node
I20260811 07:27:41.395098 21416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:41.396301 21416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:41.397502 21416 hybrid_clock.cc:648] HybridClock initialized: now 1786433261397474 us; error 46 us; skew 500 ppm
Aug 11 07:27:41 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:41.400528 21416 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:41.401572 21416 webserver.cc:460] Webserver started at http://127.11.248.62:44513/ using document root <none> and password file <none>
I20260811 07:27:41.402163 21416 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:41.402258 21416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:41.402513 21416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:41.404789 21416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "9e38c07c5a4347b58767551358dd7681"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "112e75c820fd61fdadb5875cdd3adcd5"
server_key_iv: "d9e15de9ef62bf20b115c16905e5840b"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.405467 21416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "9e38c07c5a4347b58767551358dd7681"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "112e75c820fd61fdadb5875cdd3adcd5"
server_key_iv: "d9e15de9ef62bf20b115c16905e5840b"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.409639 21416 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:41.412153 21432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:41.413511 21416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:41.413661 21416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "9e38c07c5a4347b58767551358dd7681"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "112e75c820fd61fdadb5875cdd3adcd5"
server_key_iv: "d9e15de9ef62bf20b115c16905e5840b"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.413784 21416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:41.430289 21416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:41.434769 21416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:41.435005 21416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:41.442600 21416 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:41331
I20260811 07:27:41.442685 21494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:41331 every 8 connection(s)
I20260811 07:27:41.443673 21416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:41.446640 21495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:41.451469 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 21416
I20260811 07:27:41.451651 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:41.451988 12256 external_mini_cluster.cc:1428] Setting key 3b045fe20ad74bd7879fad76f710f6ff
I20260811 07:27:41.453336 21495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Bootstrap starting.
I20260811 07:27:41.455917 21495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:41.456926 21495 log.cc:824] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:41.459262 21495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: No bootstrap required, opened a new log
Aug 11 07:27:41 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:41.464089 21495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:41.464389 21495 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:41.464481 21495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e38c07c5a4347b58767551358dd7681, State: Initialized, Role: FOLLOWER
I20260811 07:27:41.465062 21495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:41.465233 21495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:41.465332 21495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:41.465435 21495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:41.466410 21495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:41.466799 21495 leader_election.cc:302] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e38c07c5a4347b58767551358dd7681; no voters:
I20260811 07:27:41.467226 21495 leader_election.cc:288] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:41.467305 21500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:41.467538 21500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 LEADER]: Becoming Leader. State: Replica: 9e38c07c5a4347b58767551358dd7681, State: Running, Role: LEADER
I20260811 07:27:41.467867 21500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:41.468156 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:41.453579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.11.248.62:41331)
0811 07:27:41.454021 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:41.454042 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:41.454091 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:27:41.454786 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:41.454803 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:41.455141 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:41.455441 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:41.456519 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:41.457765 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:41.458946 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:41.459503 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:41.459631 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:41.462711 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:41.462717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:41.462731 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:41.462759 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:41.464712 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:41.465218 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:41.465226 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:41.465232 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:41.465408 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:41.465723 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:41.465726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:41.465728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:41.466165 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:41.466385 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:41.466716 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 07:27:41.467091 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":156,"threads_started":1}
I20260811 07:27:41.468652 21495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:41.469601 21502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e38c07c5a4347b58767551358dd7681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } } }
I20260811 07:27:41.469739 21502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:41.470084 21501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e38c07c5a4347b58767551358dd7681. Latest consensus state: current_term: 1 leader_uuid: "9e38c07c5a4347b58767551358dd7681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } } }
I20260811 07:27:41.470177 21501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:41.471029 21509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:41.474149 21509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:41.479688 21509 catalog_manager.cc:1347] Generated new cluster ID: 4afff228fa4048fc8a3ff20d05b31abd
I20260811 07:27:41.479774 21509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:41.517805 21509 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:41.519323 21509 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:41.530686 21509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Generated new TSK 0
I20260811 07:27:41.531700 21509 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:27:41.568509 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41331
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:41.683996 21522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:41.684284 21522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:41.684330 21522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:41.688459 21522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:41.688539 21522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:41.688599 21522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:41.694051 21522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:41.695228 21522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:41.696352 21522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:41.706784 21528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:41.706749 21527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:41.706905 21522 server_base.cc:1034] running on GCE node
W20260811 07:27:41.706749 21530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:41.707439 21522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:41.708140 21522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:41.709318 21522 hybrid_clock.cc:648] HybridClock initialized: now 1786433261709281 us; error 50 us; skew 500 ppm
Aug 11 07:27:41 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:41.712373 21522 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:27:41.713370 21522 webserver.cc:460] Webserver started at http://127.11.248.1:46657/ using document root <none> and password file <none>
I20260811 07:27:41.713939 21522 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:41.714028 21522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:41.714212 21522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:41.716382 21522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "0ba35bbbd44c4baf943299d8f20aa415"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "479484c79dc5d0c2e479e9b3bfe7f7f9"
server_key_iv: "5898e83d04f9f187a479dd7dd7361d15"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.717132 21522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "0ba35bbbd44c4baf943299d8f20aa415"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "479484c79dc5d0c2e479e9b3bfe7f7f9"
server_key_iv: "5898e83d04f9f187a479dd7dd7361d15"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.721609 21522 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:27:41.724324 21537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:41.725708 21522 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:27:41.725849 21522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "0ba35bbbd44c4baf943299d8f20aa415"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "479484c79dc5d0c2e479e9b3bfe7f7f9"
server_key_iv: "5898e83d04f9f187a479dd7dd7361d15"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.725989 21522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:41.738736 21522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:41.742385 21522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:41.742612 21522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:41.743254 21522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:41.744146 21522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:41.744196 21522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:41.744262 21522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:41.744294 21522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:41.753912 21522 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:45545
I20260811 07:27:41.753931 21659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:45545 every 8 connection(s)
I20260811 07:27:41.754921 21522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:41.756678 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 21522
I20260811 07:27:41.756876 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:41.757314 12256 external_mini_cluster.cc:1428] Setting key 6dbeaeedb7effae8ce53c39995cdddd3
Aug 11 07:27:41 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:27:41.772037 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:41.756975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:41093 (local address 127.11.248.62:41331)
0811 07:27:41.757142 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:41.757150 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:41.758459 (+ 1309us) server_negotiation.cc:407] Connection header received
0811 07:27:41.759747 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:41.759749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:41.759795 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:41.759858 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:41.761681 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:41.762288 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:41.764254 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:41.764509 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:41.764597 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:41.767889 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:41.767898 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:41.767901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:41.767928 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:41.769614 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:41.770326 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:41.770335 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:41.770336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:41.770424 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:41.770794 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:41.770799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:41.770802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:41.771044 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:41.771153 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:41.771698 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 07:27:41.771848 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:27:41.773115 21662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:41.757392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:41093)
0811 07:27:41.758296 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:41.758343 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:41.759499 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:41.760081 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:41.760093 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:41.760686 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:41.761510 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:41.761537 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:41.762439 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:41.762443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:41.764113 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:41.764130 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:41.764698 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:41.764705 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:41.765006 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:41.765746 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:41.765775 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:41.767696 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:41.769772 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:41.769779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:41.769821 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:41.770215 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:41.770527 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:41.770530 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:41.770532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:41.770687 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:41.771153 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:41.771162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:41.771443 (+ 281us) client_negotiation.cc:769] Sending connection context
0811 07:27:41.771640 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 07:27:41.772007 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":125,"threads_started":1}
I20260811 07:27:41.774407 21660 heartbeater.cc:347] Connected to a master server at 127.11.248.62:41331
I20260811 07:27:41.774655 21660 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:41.775183 21660 heartbeater.cc:511] Master 127.11.248.62:41331 requested a full tablet report, sending...
I20260811 07:27:41.776726 21451 ts_manager.cc:194] Registered new tserver with Master: 0ba35bbbd44c4baf943299d8f20aa415 (127.11.248.1:45545)
I20260811 07:27:41.777976 21451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:41093
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:27:41.792666 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41331
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:41.912123 21665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:41.912487 21665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:41.912573 21665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:41.916985 21665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:41.917112 21665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:41.917198 21665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:41.923183 21665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:41.924356 21665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:41.925447 21665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:41.936225 21671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:41.936280 21674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:41.936234 21672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:41.936996 21665 server_base.cc:1034] running on GCE node
I20260811 07:27:41.937604 21665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:41.938422 21665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:41.939646 21665 hybrid_clock.cc:648] HybridClock initialized: now 1786433261939614 us; error 55 us; skew 500 ppm
Aug 11 07:27:41 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:41.942924 21665 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:27:41.944056 21665 webserver.cc:460] Webserver started at http://127.11.248.2:46375/ using document root <none> and password file <none>
I20260811 07:27:41.944689 21665 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:41.944793 21665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:41.945071 21665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:41.947412 21665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "cbca42e0922b40c0a402f2f9850351bc"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "1ff67424ff1d9deea87e09dc5e71a9bd"
server_key_iv: "8ae7ad5415da52933cd2b4c542a46630"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.948051 21665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "cbca42e0922b40c0a402f2f9850351bc"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "1ff67424ff1d9deea87e09dc5e71a9bd"
server_key_iv: "8ae7ad5415da52933cd2b4c542a46630"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.952298 21665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 07:27:41.955705 21682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:41.957243 21665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:41.957409 21665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "cbca42e0922b40c0a402f2f9850351bc"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "1ff67424ff1d9deea87e09dc5e71a9bd"
server_key_iv: "8ae7ad5415da52933cd2b4c542a46630"
server_key_version: "encryptionkey@0"
I20260811 07:27:41.957566 21665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:41.986359 21665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:41.990195 21665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:41.990470 21665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:41.991219 21665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:41.992295 21665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:41.992381 21665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:41.992465 21665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:41.992524 21665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.003356 21665 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:33201
I20260811 07:27:42.003378 21802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:33201 every 8 connection(s)
I20260811 07:27:42.004426 21665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:42.011343 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 21665
I20260811 07:27:42.011512 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:42.011847 12256 external_mini_cluster.cc:1428] Setting key 35dc5e0ed537b7c4825423f6745b8397
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433261, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:42.020152 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.006604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:58365 (local address 127.11.248.62:41331)
0811 07:27:42.006749 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:42.006753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:42.007841 (+ 1088us) server_negotiation.cc:407] Connection header received
0811 07:27:42.008746 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:42.008749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:42.008897 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:42.009004 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:42.010292 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.010903 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.012244 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.012536 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.012662 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.015536 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:42.015544 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:42.015548 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:42.015589 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:42.017440 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:42.018251 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:42.018254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:42.018255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:42.018361 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:42.018821 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:42.018824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:42.018825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:42.019058 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:42.019150 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:42.019893 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 07:27:42.020025 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:27:42.021656 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.006954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:58365)
0811 07:27:42.007661 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:42.007705 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:42.008492 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:42.009196 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:42.009203 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:42.009589 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:42.010103 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.010118 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.011050 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.011053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.012099 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.012109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.012719 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.012725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.012950 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.013777 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:42.013794 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:42.015331 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:42.017573 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:42.017583 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:42.017603 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:42.018125 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:42.018461 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:42.018467 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:42.018472 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:42.018684 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:42.019189 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:42.019199 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:42.019592 (+ 393us) client_negotiation.cc:769] Sending connection context
0811 07:27:42.019845 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 07:27:42.020278 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":125,"threads_started":1}
I20260811 07:27:42.023078 21803 heartbeater.cc:347] Connected to a master server at 127.11.248.62:41331
I20260811 07:27:42.023356 21803 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:42.023906 21803 heartbeater.cc:511] Master 127.11.248.62:41331 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:27:42.025224 21451 ts_manager.cc:194] Registered new tserver with Master: cbca42e0922b40c0a402f2f9850351bc (127.11.248.2:33201)
I20260811 07:27:42.025983 21451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:58365
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:27:42.046412 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41331
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:42.162861 21809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:42.163192 21809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:42.163267 21809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:42.167382 21809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:42.167492 21809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:42.167586 21809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:42.173273 21809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:42.174439 21809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:42.175511 21809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:42.185818 21817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.185842 21815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.185786 21814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:42.185972 21809 server_base.cc:1034] running on GCE node
I20260811 07:27:42.186489 21809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:42.187215 21809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:42.188410 21809 hybrid_clock.cc:648] HybridClock initialized: now 1786433262188397 us; error 29 us; skew 500 ppm
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:42.191532 21809 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:27:42.192543 21809 webserver.cc:460] Webserver started at http://127.11.248.3:43217/ using document root <none> and password file <none>
I20260811 07:27:42.193212 21809 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:42.193313 21809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:42.193552 21809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:42.195863 21809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "cd4d8653828d4e59bd2c2ebb19ac7719"
format_stamp: "Formatted at 2026-08-11 07:27:42 on dist-test-slave-77v9"
server_key: "a46a4a39d0c26e309d8668a77ee33fce"
server_key_iv: "de141ac4115e5f1e636eb02e899f4815"
server_key_version: "encryptionkey@0"
I20260811 07:27:42.196553 21809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "cd4d8653828d4e59bd2c2ebb19ac7719"
format_stamp: "Formatted at 2026-08-11 07:27:42 on dist-test-slave-77v9"
server_key: "a46a4a39d0c26e309d8668a77ee33fce"
server_key_iv: "de141ac4115e5f1e636eb02e899f4815"
server_key_version: "encryptionkey@0"
I20260811 07:27:42.200685 21809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:27:42.203504 21825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.205016 21809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:42.205153 21809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "cd4d8653828d4e59bd2c2ebb19ac7719"
format_stamp: "Formatted at 2026-08-11 07:27:42 on dist-test-slave-77v9"
server_key: "a46a4a39d0c26e309d8668a77ee33fce"
server_key_iv: "de141ac4115e5f1e636eb02e899f4815"
server_key_version: "encryptionkey@0"
I20260811 07:27:42.205291 21809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:42.225595 21809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:42.229043 21809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:42.229277 21809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:42.229925 21809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:42.230865 21809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:42.230939 21809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.231014 21809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:42.231057 21809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.241259 21809 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:38845
I20260811 07:27:42.241279 21952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:38845 every 8 connection(s)
I20260811 07:27:42.242205 21809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:42.244757 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 21809
I20260811 07:27:42.244946 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:42.245357 12256 external_mini_cluster.cc:1428] Setting key 8e406013fae8441ab7ac428d54c915e4
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:27:42.257577 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.244336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:37891 (local address 127.11.248.62:41331)
0811 07:27:42.244532 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:42.244538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:42.245953 (+ 1415us) server_negotiation.cc:407] Connection header received
0811 07:27:42.247013 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:42.247020 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:42.247085 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:42.247166 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:42.248562 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.249200 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.250575 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.250833 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.250917 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.253800 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:42.253803 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:42.253806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:42.253833 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:42.255200 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:42.255857 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:42.255860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:42.255861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:42.255995 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:42.256423 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:42.256425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:42.256426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:42.256613 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:42.256693 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:42.257321 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 07:27:42.257445 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:27:42.258668 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.244767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:37891)
0811 07:27:42.245682 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:42.245822 (+ 140us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:42.246775 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:42.247381 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:42.247388 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:42.247814 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:42.248419 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.248434 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.249341 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.249344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.250422 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.250434 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.251001 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.251005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.251187 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.251849 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:42.251867 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:42.253618 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:42.255328 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:42.255333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:42.255347 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:42.255755 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:42.256129 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:27:42.256132 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:27:42.256134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:27:42.256317 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:27:42.256735 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:42.256742 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:42.257085 (+ 343us) client_negotiation.cc:769] Sending connection context
0811 07:27:42.257284 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 07:27:42.257572 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":175,"threads_started":1}
I20260811 07:27:42.259936 21953 heartbeater.cc:347] Connected to a master server at 127.11.248.62:41331
I20260811 07:27:42.260217 21953 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:42.260784 21953 heartbeater.cc:511] Master 127.11.248.62:41331 requested a full tablet report, sending...
I20260811 07:27:42.262068 21451 ts_manager.cc:194] Registered new tserver with Master: cd4d8653828d4e59bd2c2ebb19ac7719 (127.11.248.3:38845)
I20260811 07:27:42.262732 21451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:37891
I20260811 07:27:42.272305 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab.
Entry for principal oryx/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab.
WARNING: no policy specified for oryx/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab.
Entry for principal oryx/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab.
WARNING: no policy specified for oryx/127.11.248.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab.
Entry for principal oryx/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab.
I20260811 07:27:42.364037 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 21522
I20260811 07:27:42.372911 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 21665
I20260811 07:27:42.379096 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 21809
I20260811 07:27:42.388000 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 21416
I20260811 07:27:42.396292 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41331
--webserver_interface=127.11.248.62
--webserver_port=44513
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:41331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:27:42.512784 21963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:42.513154 21963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:42.513198 21963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:42.517510 21963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:42.517591 21963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:42.517663 21963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:42.517683 21963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:42.517704 21963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:42.523437 21963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:41331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=44513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:42.524698 21963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:42.525873 21963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:42.534839 21970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:42.535032 21963 server_base.cc:1034] running on GCE node
W20260811 07:27:42.534847 21971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.534991 21973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:42.535694 21963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:42.536988 21963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:42.538152 21963 hybrid_clock.cc:648] HybridClock initialized: now 1786433262538134 us; error 33 us; skew 500 ppm
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:42.541126 21963 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:27:42.542098 21963 webserver.cc:460] Webserver started at http://127.11.248.62:44513/ using document root <none> and password file <none>
I20260811 07:27:42.542649 21963 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:42.542721 21963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:42.546703 21963 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:27:42.548969 21980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.550307 21963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:42.550486 21963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "9e38c07c5a4347b58767551358dd7681"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "112e75c820fd61fdadb5875cdd3adcd5"
server_key_iv: "d9e15de9ef62bf20b115c16905e5840b"
server_key_version: "encryptionkey@0"
I20260811 07:27:42.551096 21963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:42.577039 21963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:42.580790 21963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:42.581055 21963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:42.589067 21963 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:41331
I20260811 07:27:42.589385 22035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:41331 every 8 connection(s)
I20260811 07:27:42.590245 21963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:42.594718 22036 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:27:42.595000 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 21963
I20260811 07:27:42.595539 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:45545
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:41331
--webserver_port=46657
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:27:42.597124 22036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Bootstrap starting.
I20260811 07:27:42.615397 22036 log.cc:824] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:42.622287 22036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:27:42.622702 22036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Bootstrap complete.
I20260811 07:27:42.626910 22036 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:42.627339 22036 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e38c07c5a4347b58767551358dd7681, State: Initialized, Role: FOLLOWER
I20260811 07:27:42.627840 22036 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:42.628000 22036 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:42.628091 22036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:42.628214 22036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:27:42.630234 22036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:42.630581 22036 leader_election.cc:302] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e38c07c5a4347b58767551358dd7681; no voters:
I20260811 07:27:42.630975 22036 leader_election.cc:288] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:27:42.631047 22040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:27:42.631265 22040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [term 2 LEADER]: Becoming Leader. State: Replica: 9e38c07c5a4347b58767551358dd7681, State: Running, Role: LEADER
I20260811 07:27:42.631577 22040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } }
I20260811 07:27:42.632283 22036 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:42.632987 22041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9e38c07c5a4347b58767551358dd7681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } } }
I20260811 07:27:42.633416 22041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:42.633315 22042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e38c07c5a4347b58767551358dd7681. Latest consensus state: current_term: 2 leader_uuid: "9e38c07c5a4347b58767551358dd7681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e38c07c5a4347b58767551358dd7681" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41331 } } }
I20260811 07:27:42.633790 22042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681 [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:42.634110 22051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:42.637490 22051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:42.638442 22051 catalog_manager.cc:1259] Loaded cluster ID: 4afff228fa4048fc8a3ff20d05b31abd
I20260811 07:27:42.638509 22051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:42.641047 22051 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:42.641791 22051 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9e38c07c5a4347b58767551358dd7681: Loaded TSK: 0
I20260811 07:27:42.643064 22051 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:27:42.716004 22038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:42.716284 22038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:42.716331 22038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:42.720739 22038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:42.720876 22038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:42.720994 22038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:42.726485 22038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.1.keytab
--principal=oryx/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:45545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=46657
--tserver_master_addrs=127.11.248.62:41331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:42.727577 22038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:42.728631 22038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:42.738797 22064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.738798 22063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.738814 22066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:42.739212 22038 server_base.cc:1034] running on GCE node
I20260811 07:27:42.739709 22038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:42.740574 22038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:42.741794 22038 hybrid_clock.cc:648] HybridClock initialized: now 1786433262741756 us; error 46 us; skew 500 ppm
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433262, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:42.745656 22038 init.cc:377] Logged in from keytab as oryx/127.11.248.1@KRBTEST.COM (short username oryx)
I20260811 07:27:42.746984 22038 webserver.cc:460] Webserver started at http://127.11.248.1:46657/ using document root <none> and password file <none>
I20260811 07:27:42.747800 22038 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:42.747932 22038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:42.753733 22038 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:42.756702 22073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.758405 22038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:42.758559 22038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "0ba35bbbd44c4baf943299d8f20aa415"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "479484c79dc5d0c2e479e9b3bfe7f7f9"
server_key_iv: "5898e83d04f9f187a479dd7dd7361d15"
server_key_version: "encryptionkey@0"
I20260811 07:27:42.759338 22038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:42.779759 22038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:42.784646 22038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:42.784932 22038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:42.785754 22038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:42.787006 22038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:42.787076 22038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.787135 22038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:42.787168 22038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.799780 22038 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:45545
I20260811 07:27:42.799796 22199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:45545 every 8 connection(s)
I20260811 07:27:42.800979 22038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:42.803930 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22038
I20260811 07:27:42.804452 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:33201
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:41331
--webserver_port=46375
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:42.817775 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.803581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:34685)
0811 07:27:42.804490 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:42.804548 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:42.805479 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:42.807048 (+ 1569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:42.807060 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:42.807643 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:42.808276 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.808293 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.810539 (+ 2246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.810544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.811613 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.811627 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.813004 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.813008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.813170 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.813925 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:42.813944 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:42.816864 (+ 2920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":156,"threads_started":1}
W20260811 07:27:42.818248 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:42.803420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:34685 (local address 127.11.248.62:41331)
0811 07:27:42.804099 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:42.804122 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:42.804752 (+ 630us) server_negotiation.cc:407] Connection header received
0811 07:27:42.805937 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:42.805955 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:42.806385 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:42.806743 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:42.808497 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.810275 (+ 1778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.811798 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.812729 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.813016 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.817231 (+ 4215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:34685: BlockingRecv error: recv got EOF from 127.11.248.1:34685 (error 108)
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":159,"threads_started":1}
W20260811 07:27:42.818359 22200 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:41331 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.248.62:41331: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:42.825099 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.818884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:45387)
0811 07:27:42.819034 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:42.819051 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:42.819149 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:42.819420 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:42.819423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:42.819655 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:42.819789 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.819796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.820583 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.820586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.821544 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.821557 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.822057 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.822060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.822163 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.822682 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:42.822698 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:42.824941 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 07:27:42.825246 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:42.818993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:45387 (local address 127.11.248.62:41331)
0811 07:27:42.819108 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:42.819111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:42.819125 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:27:42.819251 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:42.819253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:42.819299 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:42.819370 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:42.819937 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.820470 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.821692 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.821936 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.822022 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.825097 (+ 3075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:45387: BlockingRecv error: recv got EOF from 127.11.248.1:45387 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:42.831514 22204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:42.825890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:50669)
0811 07:27:42.826149 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:42.826166 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:42.826299 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:42.826576 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:42.826580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:42.826762 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:42.826850 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.826855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.827610 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.827613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.828145 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:42.828153 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.828632 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.828636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:42.828719 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.829294 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:42.829308 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:42.831365 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186}
W20260811 07:27:42.831679 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:42.826016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50669 (local address 127.11.248.62:41331)
0811 07:27:42.826149 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:42.826154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:42.826242 (+ 88us) server_negotiation.cc:407] Connection header received
0811 07:27:42.826407 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:42.826417 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:42.826473 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:42.826557 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:42.826970 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.827489 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.828271 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:42.828501 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:42.828617 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:42.831524 (+ 2907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:50669: BlockingRecv error: recv got EOF from 127.11.248.1:50669 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 07:27:42.831782 22200 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:27:42.930296 22205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:42.930613 22205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:42.930660 22205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:42.935490 22205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:42.935565 22205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:42.935662 22205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:42.941327 22205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.2.keytab
--principal=oryx/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:33201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=46375
--tserver_master_addrs=127.11.248.62:41331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:42.942530 22205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:42.943645 22205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:42.954253 22210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.954238 22211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:42.954355 22213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:42.954824 22205 server_base.cc:1034] running on GCE node
I20260811 07:27:42.955374 22205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:42.956249 22205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:42.957444 22205 hybrid_clock.cc:648] HybridClock initialized: now 1786433262957413 us; error 51 us; skew 500 ppm
Aug 11 07:27:42 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433262, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:42.961174 22205 init.cc:377] Logged in from keytab as oryx/127.11.248.2@KRBTEST.COM (short username oryx)
I20260811 07:27:42.962224 22205 webserver.cc:460] Webserver started at http://127.11.248.2:46375/ using document root <none> and password file <none>
I20260811 07:27:42.962850 22205 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:42.962965 22205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:42.967092 22205 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 07:27:42.969202 22221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.970481 22205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:42.970631 22205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "cbca42e0922b40c0a402f2f9850351bc"
format_stamp: "Formatted at 2026-08-11 07:27:41 on dist-test-slave-77v9"
server_key: "1ff67424ff1d9deea87e09dc5e71a9bd"
server_key_iv: "8ae7ad5415da52933cd2b4c542a46630"
server_key_version: "encryptionkey@0"
I20260811 07:27:42.971210 22205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:42.988636 22205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:42.992223 22205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:42.992457 22205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:42.993218 22205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:42.994109 22205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:42.994184 22205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:42.994256 22205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:42.994299 22205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:43.004235 22205 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:33201
I20260811 07:27:43.004258 22342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:33201 every 8 connection(s)
I20260811 07:27:43.005362 22205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:43.014036 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22205
I20260811 07:27:43.014633 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:38845
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:41331
--webserver_port=43217
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:27:43.017537 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.007312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:33359 (local address 127.11.248.62:41331)
0811 07:27:43.007472 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.007476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.008549 (+ 1073us) server_negotiation.cc:407] Connection header received
0811 07:27:43.009485 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.009488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.009541 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.009622 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.010799 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.011328 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.012456 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.012667 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.012749 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.017361 (+ 4612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:33359: BlockingRecv error: recv got EOF from 127.11.248.2:33359 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:27:43.018054 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.007712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:33359)
0811 07:27:43.008375 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.008431 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.009271 (+ 840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.009783 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.009789 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.010156 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.010661 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.010674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.011455 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.011458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.012331 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.012340 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.012857 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.012863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.013029 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.013634 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.013649 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.017132 (+ 3483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":106,"threads_started":1}
W20260811 07:27:43.018688 22343 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:41331 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.248.62:41331: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:43.024914 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.019216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:51633)
0811 07:27:43.019343 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.019358 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.019458 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.019717 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.019720 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.019895 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.020055 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.020065 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.020844 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.020849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.021409 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.021418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.021887 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.021891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.022029 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.022622 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.022634 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.024703 (+ 2069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:27:43.025007 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.019339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:51633 (local address 127.11.248.62:41331)
0811 07:27:43.019460 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.019465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.019481 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:43.019557 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.019560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.019609 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.019699 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.020189 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.020704 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.021544 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.021764 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.021874 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.024877 (+ 3003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:51633: BlockingRecv error: recv got EOF from 127.11.248.2:51633 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:43.031492 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.025796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:45043)
0811 07:27:43.025921 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.025936 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.026019 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.026351 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.026353 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.026510 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.026587 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.026592 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.027722 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.027724 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.028238 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.028245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.028882 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.028885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.028947 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.029475 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.029486 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.031371 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 07:27:43.031733 22343 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:27:43.031910 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.025923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:45043 (local address 127.11.248.62:41331)
0811 07:27:43.026070 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.026077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.026096 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:27:43.026148 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.026153 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.026212 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.026322 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.026708 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.027605 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.028355 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.028709 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.028850 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.031545 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:45043: BlockingRecv error: recv got EOF from 127.11.248.2:45043 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 07:27:43.132194 22347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:43.132515 22347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:43.132565 22347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:43.136948 22347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:43.137003 22347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:43.137059 22347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:43.142158 22347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/krb5kdc/oryx_127.11.248.3.keytab
--principal=oryx/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:38845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=43217
--tserver_master_addrs=127.11.248.62:41331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:43.143160 22347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:43.144194 22347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:43.153798 22355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:43.153851 22352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:43.153825 22353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:43.154232 22347 server_base.cc:1034] running on GCE node
I20260811 07:27:43.154708 22347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:43.155416 22347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:43.156605 22347 hybrid_clock.cc:648] HybridClock initialized: now 1786433263156569 us; error 51 us; skew 500 ppm
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433263, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:27:43.159530 22347 init.cc:377] Logged in from keytab as oryx/127.11.248.3@KRBTEST.COM (short username oryx)
I20260811 07:27:43.160441 22347 webserver.cc:460] Webserver started at http://127.11.248.3:43217/ using document root <none> and password file <none>
I20260811 07:27:43.161098 22347 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:43.161217 22347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:43.165544 22347 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:43.167675 22364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:43.168967 22347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:43.169111 22347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "cd4d8653828d4e59bd2c2ebb19ac7719"
format_stamp: "Formatted at 2026-08-11 07:27:42 on dist-test-slave-77v9"
server_key: "a46a4a39d0c26e309d8668a77ee33fce"
server_key_iv: "de141ac4115e5f1e636eb02e899f4815"
server_key_version: "encryptionkey@0"
I20260811 07:27:43.169672 22347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:43.192757 22347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:43.195787 22347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:43.196023 22347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:43.196741 22347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:43.197674 22347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:43.197750 22347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:43.197824 22347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:43.197868 22347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:43.209144 22347 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:38845
I20260811 07:27:43.209211 22485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:38845 every 8 connection(s)
I20260811 07:27:43.210363 22347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:43.214104 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22347
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:27:43.223424 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.212314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:56055 (local address 127.11.248.62:41331)
0811 07:27:43.212497 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.212501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.213700 (+ 1199us) server_negotiation.cc:407] Connection header received
0811 07:27:43.214913 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.214920 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.214985 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.215088 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.216736 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.217596 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.219227 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.219459 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.219533 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.223309 (+ 3776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:56055: BlockingRecv error: recv got EOF from 127.11.248.3:56055 (error 108)
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":73}
I20260811 07:27:43.224262 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.212795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:56055)
0811 07:27:43.213548 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.213592 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.214633 (+ 1041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.215289 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.215299 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.215848 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.216586 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.216609 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.217760 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.217764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.219091 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.219101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.219627 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.219630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.219820 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.220356 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.220381 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.223143 (+ 2762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":119,"threads_started":1}
W20260811 07:27:43.224814 22486 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:41331 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.248.62:41331: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
I20260811 07:27:43.225668 22491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.215250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37080 (local address 127.11.248.62:41331)
0811 07:27:43.215486 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.215490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.215502 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:27:43.215594 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.215597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.215632 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.215704 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.216637 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.217596 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.218873 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.219098 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.219208 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.221081 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:43.221087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:43.221101 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:27:43.221129 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:43.223083 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:43.223715 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:43.223721 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:43.223726 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:43.223848 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:27:43.224156 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:27:43.224158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:27:43.224159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:27:43.224644 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:43.224877 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:43.225188 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 07:27:43.225477 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":179,"thread_start_us":99,"threads_started":1}
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:43.230748 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.225321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:40703)
0811 07:27:43.225516 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.225532 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.225621 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.225975 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.225977 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.226117 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.226210 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.226215 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.226986 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.226989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.227638 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.227651 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.228186 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.228190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.228291 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.228753 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.228765 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.230643 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124}
W20260811 07:27:43.230911 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.225413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:40703 (local address 127.11.248.62:41331)
0811 07:27:43.225535 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.225540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.225577 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:27:43.225727 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.225731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.225781 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.225848 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.226332 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.226868 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.227780 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.228071 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.228153 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.230784 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:40703: BlockingRecv error: recv got EOF from 127.11.248.3:40703 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:43.236299 22489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.231393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:33145)
0811 07:27:43.231524 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.231540 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.231629 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.231840 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.231842 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.231980 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.232053 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.232057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.232854 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.232858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.233401 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.233409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.233914 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.233917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.233977 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.234466 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.234477 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.236189 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:27:43.236457 22203 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.231490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:33145 (local address 127.11.248.62:41331)
0811 07:27:43.231659 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.231662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.231674 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:27:43.231708 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.231710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.231744 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.231809 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.232151 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.232670 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.233507 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.233776 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.233860 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.236330 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:33145: BlockingRecv error: recv got EOF from 127.11.248.3:33145 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
W20260811 07:27:43.236582 22486 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:43 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:43.838992 22493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:43.832529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:34697)
0811 07:27:43.832838 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:43.832856 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:43.832975 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:43.833311 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:43.833315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:43.833611 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:43.833753 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.833761 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.834768 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.834772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.835400 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:43.835411 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.835943 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.835946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:43.836036 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.836701 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:43.836715 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:43.838851 (+ 2136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":103,"threads_started":1}
W20260811 07:27:43.839303 22494 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:43.832621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:34697 (local address 127.11.248.62:41331)
0811 07:27:43.832940 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:43.832944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:43.832966 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:27:43.833070 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:43.833072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:43.833117 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:43.833198 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:43.833897 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.834619 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.835529 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:43.835752 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:43.835839 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:43.839120 (+ 3281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:34697: BlockingRecv error: recv got EOF from 127.11.248.1:34697 (error 108)
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":135,"threads_started":1}
Aug 11 07:27:44 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:44 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:44.038444 22495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:44.032498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:44713)
0811 07:27:44.032830 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:44.032847 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:44.033062 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:44.033326 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:44.033329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:44.033572 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:44.033684 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:44.033690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.034438 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.034441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:44.035125 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:44.035134 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.035563 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.035566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:44.035631 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:44.036178 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:44.036192 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:44.038302 (+ 2110us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":79,"threads_started":1}
W20260811 07:27:44.038681 22494 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:44.032648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:44713 (local address 127.11.248.62:41331)
0811 07:27:44.032883 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:44.032890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:44.032967 (+ 77us) server_negotiation.cc:407] Connection header received
0811 07:27:44.033160 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:44.033162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:44.033209 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:44.033283 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:44.033790 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.034343 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.035235 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.035458 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.035538 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:44.038534 (+ 2996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:44713: BlockingRecv error: recv got EOF from 127.11.248.2:44713 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 07:27:44 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:44 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:44.242888 22496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:44.237336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:40035)
0811 07:27:44.237608 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:44.237624 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:44.237736 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:44.238025 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:44.238027 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:44.238216 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:44.238335 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:44.238340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.239161 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.239164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:44.239784 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:44.239794 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.240213 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.240216 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:44.240281 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:44.240850 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:44.240862 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:44.242758 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":97,"threads_started":1}
W20260811 07:27:44.243105 22494 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:44.237430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:40035 (local address 127.11.248.62:41331)
0811 07:27:44.237596 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:44.237599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:44.237812 (+ 213us) server_negotiation.cc:407] Connection header received
0811 07:27:44.237858 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:44.237860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:44.237909 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:44.237990 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:44.238448 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.239031 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.239895 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.240109 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.240190 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:44.242955 (+ 2765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:40035: BlockingRecv error: recv got EOF from 127.11.248.3:40035 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 07:27:44 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:44 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:44.845908 22497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:44.839961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:41767)
0811 07:27:44.840321 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:44.840336 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:44.840440 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:44.840709 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:44.840712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:44.841002 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:44.841104 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:44.841109 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.841871 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.841875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:44.842479 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:44.842487 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.842937 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.842940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:44.843003 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:44.843606 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:44.843617 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:44.845739 (+ 2122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":105,"threads_started":1}
W20260811 07:27:44.846107 22498 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:44.840122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:41767 (local address 127.11.248.62:41331)
0811 07:27:44.840370 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:44.840374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:44.840396 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:27:44.840536 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:44.840538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:44.840584 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:44.840664 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:44.841214 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.841766 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.842594 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:44.842820 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:44.842913 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:44.845884 (+ 2971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:41767: BlockingRecv error: recv got EOF from 127.11.248.1:41767 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":65,"threads_started":1}
Aug 11 07:27:45 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:45 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:45.048820 22499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:45.039397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:48753)
0811 07:27:45.039772 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:45.039788 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:45.039956 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:45.040256 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:45.040259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:45.040505 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:45.040602 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:45.040608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.041524 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.041530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:45.042129 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:45.042138 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.042713 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.042717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:45.042817 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:45.046538 (+ 3721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:45.046552 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:45.048647 (+ 2095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":131,"threads_started":1}
W20260811 07:27:45.049021 22498 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:45.039603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48753 (local address 127.11.248.62:41331)
0811 07:27:45.039777 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:45.039784 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:45.039890 (+ 106us) server_negotiation.cc:407] Connection header received
0811 07:27:45.040072 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:45.040075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:45.040135 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:45.040230 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:45.040740 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.041391 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.042258 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.042549 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.042656 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:45.048873 (+ 6217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:48753: BlockingRecv error: recv got EOF from 127.11.248.2:48753 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 07:27:45 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:45 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:45.250607 22500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:45.243865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:39713)
0811 07:27:45.244311 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:45.244331 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:45.244485 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:45.244879 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:45.244882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:45.245107 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:45.245210 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:45.245216 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.246080 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.246085 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:45.246688 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:45.246698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.247217 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.247220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:45.247314 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:45.247974 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:45.247989 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:45.250452 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":156,"threads_started":1}
W20260811 07:27:45.250741 22498 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:45.244159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:39713 (local address 127.11.248.62:41331)
0811 07:27:45.244346 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:45.244351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:45.244420 (+ 69us) server_negotiation.cc:407] Connection header received
0811 07:27:45.244620 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:45.244625 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:45.244682 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:45.244781 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:45.245350 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.245938 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.246830 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.247085 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.247197 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:45.250613 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:39713: BlockingRecv error: recv got EOF from 127.11.248.3:39713 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 07:27:45 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:45 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:45.852735 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:45.846791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:44959)
0811 07:27:45.847097 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:45.847114 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:45.847236 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:45.847479 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:45.847481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:45.847673 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:45.847781 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:45.847786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.848609 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.848612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:45.849366 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:45.849376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.849918 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.849922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:45.850000 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:45.850605 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:45.850617 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:45.852538 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
W20260811 07:27:45.852851 22502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:45.846975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:44959 (local address 127.11.248.62:41331)
0811 07:27:45.847237 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:45.847240 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:45.847255 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:45.847302 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:45.847305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:45.847346 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:45.847441 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:45.847906 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.848491 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.849504 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:45.849784 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:45.849950 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:45.852682 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:44959: BlockingRecv error: recv got EOF from 127.11.248.1:44959 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
Aug 11 07:27:46 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:46 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:46.055688 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:46.049780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:41845)
0811 07:27:46.050086 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:46.050101 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:46.050211 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:46.050471 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:46.050473 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:46.050663 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:46.050761 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:46.050766 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.051529 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.051531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:46.052082 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:46.052090 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.052656 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.052663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:46.052751 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:46.053368 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:46.053383 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:46.055571 (+ 2188us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":104,"threads_started":1}
W20260811 07:27:46.056034 22502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:46.049892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:41845 (local address 127.11.248.62:41331)
0811 07:27:46.050076 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:46.050081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:46.050181 (+ 100us) server_negotiation.cc:407] Connection header received
0811 07:27:46.050299 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:46.050301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:46.050347 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:46.050428 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:46.050902 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.051428 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.052253 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.052512 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.052627 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:46.055740 (+ 3113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:41845: BlockingRecv error: recv got EOF from 127.11.248.2:41845 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 07:27:46 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:46 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:46.258693 22504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:46.251814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:57981)
0811 07:27:46.252181 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:46.252195 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:46.252305 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:46.252600 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:46.252603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:46.252917 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:46.253023 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:46.253030 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.254055 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.254058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:46.254710 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:46.254719 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.255453 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.255456 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:46.255524 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:46.256234 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:46.256249 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:46.258570 (+ 2321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":145,"threads_started":1}
W20260811 07:27:46.259083 22502 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:46.251974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:57981 (local address 127.11.248.62:41331)
0811 07:27:46.252188 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:46.252193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:46.252262 (+ 69us) server_negotiation.cc:407] Connection header received
0811 07:27:46.252384 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:46.252386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:46.252436 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:46.252526 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:46.253171 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.253863 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.254960 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.255321 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.255423 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:46.258973 (+ 3550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:57981: BlockingRecv error: recv got EOF from 127.11.248.3:57981 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 11 07:27:46 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:46 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:46.860656 22505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:46.853883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:33231)
0811 07:27:46.854265 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:46.854279 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:46.854386 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:46.854759 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:46.854762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:46.855058 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:46.855161 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:46.855168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.856380 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.856383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:46.857176 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:46.857186 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.857823 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.857826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:46.857924 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:46.858548 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:46.858561 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:46.860530 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":135,"threads_started":1}
W20260811 07:27:46.861045 22506 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:46.854130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:33231 (local address 127.11.248.62:41331)
0811 07:27:46.854428 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:46.854432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:46.854467 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:27:46.854522 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:46.854524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:46.854602 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:46.854849 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:46.855325 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.856188 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.857380 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:46.857696 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:46.857796 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:46.860887 (+ 3091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:33231: BlockingRecv error: recv got EOF from 127.11.248.1:33231 (error 108)
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":115,"threads_started":1}
Aug 11 07:27:47 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:47 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:47.062461 22507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:47.056559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:48711)
0811 07:27:47.056880 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:47.056899 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:47.057007 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:47.057328 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:47.057331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:47.057525 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:47.057635 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:47.057640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.058509 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.058511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:47.059087 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:47.059095 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.059568 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.059570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:47.059632 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:47.060247 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:47.060260 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:47.062330 (+ 2070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":100,"threads_started":1}
W20260811 07:27:47.062740 22506 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:47.056631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48711 (local address 127.11.248.62:41331)
0811 07:27:47.056934 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:47.056939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:47.056960 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:27:47.057116 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:47.057119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:47.057167 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:47.057250 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:47.057751 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.058399 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.059206 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.059461 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.059548 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:47.062572 (+ 3024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:48711: BlockingRecv error: recv got EOF from 127.11.248.2:48711 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 07:27:47 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:47 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:47.265873 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:47.259607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:54817)
0811 07:27:47.260010 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:47.260027 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:47.260207 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:47.260513 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:47.260516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:47.260738 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:47.260872 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:47.260878 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.261666 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.261673 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:47.262230 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:47.262238 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.262721 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.262725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:47.262820 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:47.263439 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:47.263451 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:47.265688 (+ 2237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":139,"threads_started":1}
W20260811 07:27:47.265947 22506 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:47.259868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:54817 (local address 127.11.248.62:41331)
0811 07:27:47.260026 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:47.260031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:47.260133 (+ 102us) server_negotiation.cc:407] Connection header received
0811 07:27:47.260330 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:47.260333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:47.260390 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:47.260487 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:47.260999 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.261546 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.262366 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.262592 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.262704 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:47.265831 (+ 3127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:54817: BlockingRecv error: recv got EOF from 127.11.248.3:54817 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 07:27:47 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:47 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:47.868419 22509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:47.861792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:51645)
0811 07:27:47.862266 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:47.862281 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:47.862384 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:47.862627 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:47.862629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:47.862829 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:47.862939 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:47.862943 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.864017 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.864021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:47.864732 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:47.864744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.865329 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.865332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:47.865414 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:47.866098 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:47.866111 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:47.868237 (+ 2126us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":119,"threads_started":1}
W20260811 07:27:47.868572 22510 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:47.862066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:51645 (local address 127.11.248.62:41331)
0811 07:27:47.862386 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:47.862390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:47.862407 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:27:47.862457 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:47.862459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:47.862502 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:47.862588 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:47.863096 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.863880 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.864940 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:47.865197 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:47.865321 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:47.868438 (+ 3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:51645: BlockingRecv error: recv got EOF from 127.11.248.1:51645 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":105,"threads_started":1}
Aug 11 07:27:48 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:48 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:48.070876 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:48.063465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:60809)
0811 07:27:48.063947 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:48.063962 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:48.064068 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:48.064402 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:48.064405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:48.064612 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:48.064714 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:48.064719 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.065911 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.065914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:48.066643 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:48.066654 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.067448 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.067452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:48.067522 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:48.068166 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:48.068178 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:48.070694 (+ 2516us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":141,"threads_started":1}
W20260811 07:27:48.070982 22510 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:48.063659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:60809 (local address 127.11.248.62:41331)
0811 07:27:48.063839 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:48.063852 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:48.064041 (+ 189us) server_negotiation.cc:407] Connection header received
0811 07:27:48.064177 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:48.064182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:48.064247 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:48.064344 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:48.064871 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.065773 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.066774 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.067191 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.067314 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:48.070845 (+ 3531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:60809: BlockingRecv error: recv got EOF from 127.11.248.2:60809 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 07:27:48 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:48 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:48.272953 22512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:48.267026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:38857)
0811 07:27:48.267292 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:48.267331 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:48.267428 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:48.267683 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:48.267686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:48.267884 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:48.267976 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:48.267981 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.268890 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.268897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:48.269455 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:48.269464 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.270001 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.270004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:48.270077 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:48.270825 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:48.270837 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:48.272768 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":97,"threads_started":1}
W20260811 07:27:48.273180 22510 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:48.267105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:38857 (local address 127.11.248.62:41331)
0811 07:27:48.267257 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:48.267261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:48.267405 (+ 144us) server_negotiation.cc:407] Connection header received
0811 07:27:48.267517 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:48.267519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:48.267565 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:48.267647 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:48.268119 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.268710 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.269599 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.269824 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.269930 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:48.273002 (+ 3072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:38857: BlockingRecv error: recv got EOF from 127.11.248.3:38857 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 07:27:48 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:48 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:48.876063 22513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:48.869507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:58329)
0811 07:27:48.870008 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:48.870025 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:48.870159 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:48.870471 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:48.870475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:48.870705 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:48.870805 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:48.870810 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.871679 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.871684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:48.872274 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:48.872283 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.872799 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.872802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:48.872937 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:48.873553 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:48.873591 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:48.875908 (+ 2317us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":96,"threads_started":1}
W20260811 07:27:48.876279 22514 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:48.869554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:58329 (local address 127.11.248.62:41331)
0811 07:27:48.869894 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:48.869898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:48.870124 (+ 226us) server_negotiation.cc:407] Connection header received
0811 07:27:48.870259 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:48.870263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:48.870330 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:48.870449 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:48.870968 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.871557 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.872418 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:48.872663 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:48.872780 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:48.876110 (+ 3330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:58329: BlockingRecv error: recv got EOF from 127.11.248.1:58329 (error 108)
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":103,"threads_started":1}
Aug 11 07:27:49 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:49 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:49.078418 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:49.071987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:59215)
0811 07:27:49.072359 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:49.072379 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:49.072515 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:49.072838 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:49.072842 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:49.073144 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:49.073248 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:49.073254 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.074153 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.074157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:49.074807 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:49.074817 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.075335 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.075339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:49.075436 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:49.076073 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:49.076085 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:49.078289 (+ 2204us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":106,"threads_started":1}
W20260811 07:27:49.078598 22514 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:49.072105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:59215 (local address 127.11.248.62:41331)
0811 07:27:49.072327 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:49.072333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:49.072466 (+ 133us) server_negotiation.cc:407] Connection header received
0811 07:27:49.072630 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:49.072636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:49.072696 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:49.072776 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:49.073381 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.074025 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.074934 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.075180 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.075303 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:49.078462 (+ 3159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:59215: BlockingRecv error: recv got EOF from 127.11.248.2:59215 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 11 07:27:49 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:49 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:49.280416 22516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:49.273944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:44129)
0811 07:27:49.274454 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:49.274469 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:49.274607 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:49.274939 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:49.274942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:49.275199 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:49.275301 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:49.275307 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.276248 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.276251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:49.276869 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:49.276878 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.277568 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.277571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:49.277642 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:49.278207 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:49.278219 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:49.280270 (+ 2051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":117,"threads_started":1}
W20260811 07:27:49.280620 22514 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:49.274041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44129 (local address 127.11.248.62:41331)
0811 07:27:49.274217 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:49.274224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:49.274562 (+ 338us) server_negotiation.cc:407] Connection header received
0811 07:27:49.274717 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:49.274720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:49.274796 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:49.274882 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:49.275445 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.276133 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.277010 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.277423 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.277525 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:49.280466 (+ 2941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:44129: BlockingRecv error: recv got EOF from 127.11.248.3:44129 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 07:27:49 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:49 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:49.883428 22517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:49.876961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:40193)
0811 07:27:49.877292 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:49.877306 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:49.877420 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:49.877701 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:49.877703 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:49.877950 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:49.878053 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:49.878058 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.878998 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.879001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:49.879551 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:49.879559 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.880089 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.880091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:49.880155 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:49.880760 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:49.880773 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:49.883243 (+ 2470us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
W20260811 07:27:49.883530 22519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:49.877017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:40193 (local address 127.11.248.62:41331)
0811 07:27:49.877286 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:49.877290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:49.877412 (+ 122us) server_negotiation.cc:407] Connection header received
0811 07:27:49.877519 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:49.877521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:49.877577 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:49.877658 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:49.878225 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.878870 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.879693 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:49.879973 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:49.880067 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:49.883383 (+ 3316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:40193: BlockingRecv error: recv got EOF from 127.11.248.1:40193 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":105,"threads_started":1}
Aug 11 07:27:50 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:50 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:50.089105 22520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:50.079256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:56297)
0811 07:27:50.079624 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:50.079641 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:50.079751 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:50.080028 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:50.080030 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:50.080225 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:50.080325 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:50.080331 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.081120 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.081123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:50.081672 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:50.081680 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.082185 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.082188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:50.082259 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:50.086596 (+ 4337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:50.086611 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:50.088944 (+ 2333us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":114,"threads_started":1}
W20260811 07:27:50.089556 22519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:50.079320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:56297 (local address 127.11.248.62:41331)
0811 07:27:50.079468 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:50.079471 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:50.079711 (+ 240us) server_negotiation.cc:407] Connection header received
0811 07:27:50.079862 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:50.079864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:50.079912 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:50.079984 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:50.080428 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.081008 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.081771 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.082020 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.082102 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:50.089178 (+ 7076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:56297: BlockingRecv error: recv got EOF from 127.11.248.2:56297 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 07:27:50 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:50 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:50.289440 22521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:50.281475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:35975)
0811 07:27:50.281851 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:50.281871 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:50.282035 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:50.282381 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:50.282385 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:50.282654 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:50.282765 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:50.282771 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.283800 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.283806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:50.284764 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:50.284776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.285494 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.285500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:50.285606 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:50.286322 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:50.286338 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:50.289209 (+ 2871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
W20260811 07:27:50.289629 22519 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:50.281595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:35975 (local address 127.11.248.62:41331)
0811 07:27:50.281737 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:50.281741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:50.281961 (+ 220us) server_negotiation.cc:407] Connection header received
0811 07:27:50.282166 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:50.282169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:50.282238 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:50.282354 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:50.282907 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.283661 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.284911 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.285335 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.285485 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:50.289472 (+ 3987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:35975: BlockingRecv error: recv got EOF from 127.11.248.3:35975 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 07:27:50 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:50 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:50.891542 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:50.884598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:50645)
0811 07:27:50.885008 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:50.885027 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:50.885153 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:50.885508 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:50.885513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:50.885784 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:50.885905 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:50.885911 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.886751 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.886754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:50.887415 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:50.887425 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.887964 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.887967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:50.888070 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:50.888899 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:50.888915 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:50.891371 (+ 2456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":180,"threads_started":1}
W20260811 07:27:50.891750 22523 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:50.884776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50645 (local address 127.11.248.62:41331)
0811 07:27:50.885070 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:50.885075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:50.885118 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:27:50.885290 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:50.885295 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:50.885354 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:50.885454 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:50.886026 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.886618 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.887572 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:50.887805 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:50.887915 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:50.891567 (+ 3652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:50645: BlockingRecv error: recv got EOF from 127.11.248.1:50645 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":64,"threads_started":1}
Aug 11 07:27:51 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:51 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:51.096201 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:51.090078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:59683)
0811 07:27:51.090370 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:51.090383 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:51.090487 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:51.090736 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:51.090738 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:51.090948 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:51.091050 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:51.091055 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.091989 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.091991 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:51.092538 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:51.092545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.093026 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.093029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:51.093101 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:51.093743 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:51.093756 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:51.096014 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":98,"threads_started":1}
W20260811 07:27:51.096477 22523 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:51.090152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:59683 (local address 127.11.248.62:41331)
0811 07:27:51.090340 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:51.090344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:51.090463 (+ 119us) server_negotiation.cc:407] Connection header received
0811 07:27:51.090572 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:51.090574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:51.090620 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:51.090697 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:51.091176 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.091855 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.092642 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.092881 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.092988 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:51.096328 (+ 3340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:59683: BlockingRecv error: recv got EOF from 127.11.248.2:59683 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 07:27:51 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:51 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:51.297317 22526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:51.290859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:51303)
0811 07:27:51.291179 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:51.291193 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:51.291338 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:51.291711 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:51.291717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:51.291978 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:51.292112 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:51.292127 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.293061 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.293064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:51.293642 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:51.293650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.294156 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.294159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:51.294234 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:51.294879 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:51.294892 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:51.297138 (+ 2246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":91,"threads_started":1}
W20260811 07:27:51.297428 22523 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:51.290924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:51303 (local address 127.11.248.62:41331)
0811 07:27:51.291094 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:51.291099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:51.291279 (+ 180us) server_negotiation.cc:407] Connection header received
0811 07:27:51.291456 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:51.291460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:51.291542 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:51.291632 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:51.292238 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.292844 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.293763 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.294013 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.294100 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:51.297290 (+ 3190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:51303: BlockingRecv error: recv got EOF from 127.11.248.3:51303 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 07:27:51 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:51 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:51.899112 22527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:51.892645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:53119)
0811 07:27:51.893031 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:51.893045 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:51.893148 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:51.893473 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:51.893476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:51.893677 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:51.893841 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:51.893848 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.894643 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.894645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:51.895289 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:51.895299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.895850 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.895853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:51.895937 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:51.896476 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:51.896489 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:51.898985 (+ 2496us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":152,"threads_started":1}
W20260811 07:27:51.899453 22528 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:51.892781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:53119 (local address 127.11.248.62:41331)
0811 07:27:51.893098 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:51.893101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:51.893116 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:27:51.893265 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:51.893267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:51.893313 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:51.893414 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:51.893961 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.894522 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.895444 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:51.895675 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:51.895759 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:51.899308 (+ 3549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:53119: BlockingRecv error: recv got EOF from 127.11.248.1:53119 (error 108)
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":128,"threads_started":1}
Aug 11 07:27:52 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:52 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:52.103981 22530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:52.097182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:53543)
0811 07:27:52.097569 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:52.097586 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:52.097748 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:52.098177 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:52.098181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:52.098491 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:52.098626 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:52.098633 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.099476 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.099479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:52.100220 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:52.100232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.100967 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.100971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:52.101048 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:52.101702 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:52.101716 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:52.103817 (+ 2101us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":162,"threads_started":1}
W20260811 07:27:52.104291 22528 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:52.097315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:53543 (local address 127.11.248.62:41331)
0811 07:27:52.097551 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:52.097560 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:52.097681 (+ 121us) server_negotiation.cc:407] Connection header received
0811 07:27:52.097883 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:52.097890 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:52.097972 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:52.098064 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:52.098761 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.099349 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.100395 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.100661 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.100921 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:52.104012 (+ 3091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:53543: BlockingRecv error: recv got EOF from 127.11.248.2:53543 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 11 07:27:52 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:52 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:52.304570 22531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:52.298296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:40535)
0811 07:27:52.298603 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:52.298617 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:52.298721 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:52.298973 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:52.298976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:52.299182 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:52.299297 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:52.299303 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.300152 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.300155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:52.300729 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:52.300738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.301321 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.301324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:52.301391 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:52.301930 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:52.301942 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:52.304353 (+ 2411us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":106,"threads_started":1}
W20260811 07:27:52.304652 22528 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:52.298429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:40535 (local address 127.11.248.62:41331)
0811 07:27:52.298577 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:52.298581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:52.298702 (+ 121us) server_negotiation.cc:407] Connection header received
0811 07:27:52.298795 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:52.298797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:52.298845 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:52.298932 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:52.299452 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.300022 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.300931 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.301180 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.301292 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:52.304518 (+ 3226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:40535: BlockingRecv error: recv got EOF from 127.11.248.3:40535 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 07:27:52 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:52 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:52.906312 22532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:52.900082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:55361)
0811 07:27:52.900394 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:52.900412 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:52.900506 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:52.900763 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:52.900765 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:52.901045 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:52.901151 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:52.901156 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.902000 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.902002 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:52.902557 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:52.902564 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.903050 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.903053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:52.903120 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:52.903693 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:52.903705 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:52.906117 (+ 2412us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":117,"threads_started":1}
W20260811 07:27:52.906435 22534 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:52.900237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:55361 (local address 127.11.248.62:41331)
0811 07:27:52.900496 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:52.900500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:52.900516 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:52.900596 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:52.900598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:52.900641 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:52.900717 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:52.901284 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.901886 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.902666 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:52.902903 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:52.902989 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:52.906300 (+ 3311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:55361: BlockingRecv error: recv got EOF from 127.11.248.1:55361 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":102,"threads_started":1}
Aug 11 07:27:53 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:53 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:53.110797 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:53.104894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:48853)
0811 07:27:53.105182 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:53.105204 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:53.105342 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:53.105622 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:53.105625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:53.105895 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:53.105992 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:53.105998 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.106790 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.106795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:53.107388 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:53.107396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.107864 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.107868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:53.107955 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:53.108547 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:53.108559 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:53.110623 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":92,"threads_started":1}
W20260811 07:27:53.110867 22534 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:53.104961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48853 (local address 127.11.248.62:41331)
0811 07:27:53.105149 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:53.105154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:53.105287 (+ 133us) server_negotiation.cc:407] Connection header received
0811 07:27:53.105449 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:53.105453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:53.105509 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:53.105599 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:53.106123 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.106674 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.107514 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.107742 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.107853 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:53.110755 (+ 2902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:48853: BlockingRecv error: recv got EOF from 127.11.248.2:48853 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 07:27:53 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:53 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:53.312155 22536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:53.305505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:51381)
0811 07:27:53.305913 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:53.305931 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:53.306045 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:53.306380 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:53.306384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:53.306642 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:53.306748 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:53.306754 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.307940 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.307949 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:53.308710 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:53.308721 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.309265 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.309268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:53.309342 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:53.309940 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:53.309952 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:53.311973 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":144,"threads_started":1}
W20260811 07:27:53.312217 22534 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:53.305730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:51381 (local address 127.11.248.62:41331)
0811 07:27:53.305914 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:53.305920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:53.305994 (+ 74us) server_negotiation.cc:407] Connection header received
0811 07:27:53.306180 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:53.306182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:53.306245 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:53.306361 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:53.306912 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.307738 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.308853 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.309155 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.309240 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:53.312105 (+ 2865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:51381: BlockingRecv error: recv got EOF from 127.11.248.3:51381 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 07:27:53 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:53 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:53.913125 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:53.907225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:38659)
0811 07:27:53.907560 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:53.907575 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:53.907676 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:53.907994 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:53.907997 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:53.908235 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:53.908361 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:53.908370 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.909177 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.909180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:53.909754 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:53.909763 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.910187 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.910189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:53.910252 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:53.910836 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:53.910849 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:53.912932 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":120,"threads_started":1}
W20260811 07:27:53.913517 22538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:53.907395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:38659 (local address 127.11.248.62:41331)
0811 07:27:53.907643 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:53.907646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:53.907662 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:53.907773 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:53.907775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:53.907820 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:53.907918 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:53.908500 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.909068 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.909871 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:53.910085 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:53.910159 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:53.913162 (+ 3003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:38659: BlockingRecv error: recv got EOF from 127.11.248.1:38659 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":77,"threads_started":1}
Aug 11 07:27:54 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:54 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:54.117666 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:54.111781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:57801)
0811 07:27:54.112064 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:54.112078 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:54.112180 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:54.112461 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:54.112473 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:54.112773 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:54.112923 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:54.112930 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.113704 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.113707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:54.114273 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:54.114281 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.114748 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.114751 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:54.114816 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:54.115381 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:54.115393 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:54.117523 (+ 2130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":105,"threads_started":1}
W20260811 07:27:54.117789 22538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:54.111843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:57801 (local address 127.11.248.62:41331)
0811 07:27:54.111998 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:54.112002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:54.112152 (+ 150us) server_negotiation.cc:407] Connection header received
0811 07:27:54.112259 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:54.112261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:54.112305 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:54.112380 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:54.113047 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.113590 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.114431 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.114643 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.114720 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:54.117667 (+ 2947us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:57801: BlockingRecv error: recv got EOF from 127.11.248.2:57801 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:27:54 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:54 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:54.318849 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:54.313149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:48527)
0811 07:27:54.313491 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:54.313507 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:54.313646 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:54.313982 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:54.313984 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:54.314212 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:54.314305 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:54.314311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.315089 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.315094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:54.315660 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:54.315667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.316146 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.316150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:54.316236 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:54.316773 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:54.316784 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:54.318673 (+ 1889us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":91,"threads_started":1}
W20260811 07:27:54.318928 22538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:54.313275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:48527 (local address 127.11.248.62:41331)
0811 07:27:54.313439 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:54.313444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:54.313594 (+ 150us) server_negotiation.cc:407] Connection header received
0811 07:27:54.313760 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:54.313764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:54.313820 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:54.313964 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:54.314434 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.314974 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.315785 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.316024 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.316131 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:54.318803 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:48527: BlockingRecv error: recv got EOF from 127.11.248.3:48527 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 07:27:54 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:54 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:54.921054 22541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:54.914259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:50407)
0811 07:27:54.914614 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:54.914631 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:54.914785 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:54.915254 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:54.915257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:54.915538 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:54.915660 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:54.915667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.916970 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.916973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:54.917537 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:54.917546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.918044 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.918047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:54.918132 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:54.918706 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:54.918719 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:54.920914 (+ 2195us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":143,"threads_started":1}
W20260811 07:27:54.921267 22542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:54.914478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50407 (local address 127.11.248.62:41331)
0811 07:27:54.914764 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:54.914770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:54.914790 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:27:54.914933 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:54.914937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:54.914996 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:54.915118 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:54.915838 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.916780 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.917653 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:54.917897 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:54.917983 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:54.921061 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:50407: BlockingRecv error: recv got EOF from 127.11.248.1:50407 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":83,"threads_started":1}
Aug 11 07:27:55 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:55 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:55.128875 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:55.118566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:48221)
0811 07:27:55.118847 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:55.118863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:55.119000 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:55.119266 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:55.119267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:55.119469 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:55.119566 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:55.119572 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.120454 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.120456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:55.121185 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:55.121201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.121820 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.121824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:55.121928 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:55.126691 (+ 4763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:55.126704 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:55.128685 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
W20260811 07:27:55.129072 22542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:55.118752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48221 (local address 127.11.248.62:41331)
0811 07:27:55.118965 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:55.118969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:55.118986 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:27:55.119095 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:55.119098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:55.119145 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:55.119227 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:55.119687 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.120329 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.121309 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.121667 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.121789 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:55.128907 (+ 7118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:48221: BlockingRecv error: recv got EOF from 127.11.248.2:48221 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:27:55 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:55 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:55.325677 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:55.319707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:44451)
0811 07:27:55.320039 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:55.320055 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:55.320155 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:55.320433 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:55.320436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:55.320641 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:55.320737 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:55.320742 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.321564 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.321567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:55.322164 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:55.322171 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.322647 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.322649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:55.322729 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:55.323258 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:55.323270 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:55.325501 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":94,"threads_started":1}
W20260811 07:27:55.325794 22542 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:55.319910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44451 (local address 127.11.248.62:41331)
0811 07:27:55.320100 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:55.320104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:55.320120 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:27:55.320266 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:55.320268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:55.320315 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:55.320385 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:55.320896 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.321461 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.322317 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.322540 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.322622 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:55.325654 (+ 3032us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:44451: BlockingRecv error: recv got EOF from 127.11.248.3:44451 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 07:27:55 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:55 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:55.927881 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:55.922057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:59591)
0811 07:27:55.922360 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:55.922374 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:55.922499 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:55.922858 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:55.922860 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:55.923054 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:55.923156 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:55.923161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.923981 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.923984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:55.924580 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:55.924589 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.925030 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.925033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:55.925100 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:55.925613 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:55.925625 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:55.927699 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":94,"threads_started":1}
W20260811 07:27:55.927968 22546 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:55.922098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:59591 (local address 127.11.248.62:41331)
0811 07:27:55.922408 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:55.922415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:55.922434 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:27:55.922626 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:55.922629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:55.922696 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:55.922800 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:55.923284 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.923851 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.924691 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:55.924935 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:55.925010 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:55.927839 (+ 2829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:59591: BlockingRecv error: recv got EOF from 127.11.248.1:59591 (error 108)
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":131,"threads_started":1}
Aug 11 07:27:56 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:56 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:56.136304 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:56.129721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:48525)
0811 07:27:56.130059 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:56.130076 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:56.130219 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:56.130487 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:56.130490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:56.130713 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:56.130867 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:56.130873 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.131688 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.131691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:56.132691 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:56.132705 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.133415 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.133418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:56.133505 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:56.134152 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:56.134165 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:56.136173 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":181,"threads_started":1}
W20260811 07:27:56.136519 22546 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:56.129892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48525 (local address 127.11.248.62:41331)
0811 07:27:56.130050 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:56.130054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:56.130157 (+ 103us) server_negotiation.cc:407] Connection header received
0811 07:27:56.130323 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:56.130326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:56.130379 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:56.130464 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:56.130992 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.131540 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.132866 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.133292 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.133407 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:56.136368 (+ 2961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:48525: BlockingRecv error: recv got EOF from 127.11.248.2:48525 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 07:27:56 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:56 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:56.332342 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:56.326631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:58265)
0811 07:27:56.326927 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:56.326942 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:56.327045 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:56.327288 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:56.327290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:56.327481 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:56.327576 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:56.327580 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.328353 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.328355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:56.328955 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:56.328963 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.329372 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.329375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:56.329433 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:56.329973 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:56.329984 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:56.332172 (+ 2188us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":107,"threads_started":1}
W20260811 07:27:56.332509 22546 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:56.326809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:58265 (local address 127.11.248.62:41331)
0811 07:27:56.326953 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:56.326956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:56.326998 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:27:56.327133 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:56.327135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:56.327182 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:56.327245 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:56.327687 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.328251 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.329052 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.329264 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.329344 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:56.332350 (+ 3006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:58265: BlockingRecv error: recv got EOF from 127.11.248.3:58265 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 07:27:56 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:56 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:56.934825 22549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:56.928973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:47815)
0811 07:27:56.929269 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:56.929288 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:56.929424 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:56.929686 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:56.929688 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:56.929900 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:56.930005 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:56.930011 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.930805 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.930808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:56.931388 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:56.931398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.931847 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.931851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:56.931929 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:56.932573 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:56.932585 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:56.934702 (+ 2117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":105,"threads_started":1}
W20260811 07:27:56.935204 22550 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:56.928999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:47815 (local address 127.11.248.62:41331)
0811 07:27:56.929306 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:56.929310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:56.929360 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:27:56.929519 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:56.929521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:56.929568 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:56.929647 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:56.930112 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.930672 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.931509 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:56.931735 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:56.931852 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:56.934902 (+ 3050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:47815: BlockingRecv error: recv got EOF from 127.11.248.1:47815 (error 108)
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":93,"threads_started":1}
Aug 11 07:27:57 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:57 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:57.143632 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:57.137141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:52347)
0811 07:27:57.137501 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:57.137518 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:57.137763 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:57.138099 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:57.138102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:57.138378 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:57.138482 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:57.138488 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.139413 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.139420 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:57.140081 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:57.140090 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.140626 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.140630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:57.140727 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:57.141344 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:57.141357 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:57.143453 (+ 2096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":108,"threads_started":1}
W20260811 07:27:57.143745 22550 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:57.137303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:52347 (local address 127.11.248.62:41331)
0811 07:27:57.137495 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:57.137500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:57.137678 (+ 178us) server_negotiation.cc:407] Connection header received
0811 07:27:57.137902 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:57.137906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:57.137968 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:57.138072 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:57.138627 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.139283 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.140221 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.140490 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.140619 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:57.143625 (+ 3006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:52347: BlockingRecv error: recv got EOF from 127.11.248.2:52347 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 07:27:57 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:57 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.3@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:57.339335 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:57.333281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.3:40309)
0811 07:27:57.333604 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:57.333618 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:57.333733 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:57.334045 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:57.334048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:57.334289 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:57.334416 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:57.334428 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.335210 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.335213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:57.335815 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:57.335824 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.336386 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.336389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:57.336458 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:57.337101 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:57.337116 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:57.339199 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":113,"threads_started":1}
W20260811 07:27:57.339555 22550 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:57.333417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:40309 (local address 127.11.248.62:41331)
0811 07:27:57.333584 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:57.333588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:57.333693 (+ 105us) server_negotiation.cc:407] Connection header received
0811 07:27:57.333820 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:57.333822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:57.333876 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:57.333970 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:57.334550 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.335105 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.335965 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.336216 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.336348 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:57.339425 (+ 3077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.3:40309: BlockingRecv error: recv got EOF from 127.11.248.3:40309 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 07:27:57 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:57 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.1@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:57.942626 22553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:57.935952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.1:40997)
0811 07:27:57.936229 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:57.936243 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:57.936348 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:57.936617 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:57.936620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:57.936894 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:57.937007 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:57.937013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.938042 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.938045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:57.938618 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:57.938626 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.939241 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.939244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:57.939326 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:57.939999 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:57.940011 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:57.942474 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":98,"threads_started":1}
W20260811 07:27:57.942837 22554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:57.935969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:40997 (local address 127.11.248.62:41331)
0811 07:27:57.936245 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:57.936249 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:57.936325 (+ 76us) server_negotiation.cc:407] Connection header received
0811 07:27:57.936446 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:57.936448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:57.936494 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:57.936578 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:57.937172 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.937910 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.938859 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:57.939119 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:57.939214 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:57.942680 (+ 3466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.1:40997: BlockingRecv error: recv got EOF from 127.11.248.1:40997 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":119,"threads_started":1}
Aug 11 07:27:58 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:27:58 dist-test-slave-77v9 krb5kdc[21403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.248.2@KRBTEST.COM for oryx/127.11.248.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:27:58.150630 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:58.144625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41331 (local address 127.11.248.2:55625)
0811 07:27:58.145002 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:58.145018 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:58.145116 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:58.145358 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:58.145360 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:58.145554 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:58.145650 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:58.145655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.146428 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.146430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:58.147021 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:58.147030 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.147525 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.147528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:58.147594 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:58.148159 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:27:58.148172 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:58.150492 (+ 2320us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.248.62:41331: Server oryx/127.11.248.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":112,"threads_started":1}
W20260811 07:27:58.150952 22554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:58.144738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:55625 (local address 127.11.248.62:41331)
0811 07:27:58.144998 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:58.145002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:58.145100 (+ 98us) server_negotiation.cc:407] Connection header received
0811 07:27:58.145186 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:58.145188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:58.145233 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:58.145319 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:58.145757 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.146323 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.147150 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.147399 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.147484 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:58.150670 (+ 3186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.248.2:55625: BlockingRecv error: recv got EOF from 127.11.248.2:55625 (error 108)
Metrics: {"server-negotiator.queue_time_us":154}
I20260811 07:27:58.224045 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22038
I20260811 07:27:58.233913 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22205
I20260811 07:27:58.241142 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22347
I20260811 07:27:58.248219 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 21963
2026-08-11T07:27:58Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18276 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T07:27:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:58Z Disabled control of system clock
I20260811 07:27:58.285610 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44301
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:43177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:44301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:27:58.406189 22560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:58.406531 22560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:58.406569 22560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:58.410713 22560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:58.410799 22560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:58.410815 22560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:58.410832 22560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:58.410848 22560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:58.415839 22560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:44301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:58.417034 22560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:58.418424 22560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:58.427564 22566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:58.427585 22568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:58.427554 22565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:58.427831 22560 server_base.cc:1034] running on GCE node
I20260811 07:27:58.428589 22560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:58.429943 22560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:58.431156 22560 hybrid_clock.cc:648] HybridClock initialized: now 1786433278431136 us; error 36 us; skew 500 ppm
I20260811 07:27:58.433859 22560 webserver.cc:460] Webserver started at http://127.11.248.62:43195/ using document root <none> and password file <none>
I20260811 07:27:58.434583 22560 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:58.434690 22560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:58.434949 22560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:58.437371 22560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "58d56af479ff423d8714ed79c2083b8b"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "7da032b365b173b4255f850ea02db28b"
server_key_iv: "f74dd6c668dcf4311cc0a28992692d2f"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.438026 22560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "58d56af479ff423d8714ed79c2083b8b"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "7da032b365b173b4255f850ea02db28b"
server_key_iv: "f74dd6c668dcf4311cc0a28992692d2f"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.442274 22560 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:58.445115 22575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.446626 22560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:27:58.446825 22560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "58d56af479ff423d8714ed79c2083b8b"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "7da032b365b173b4255f850ea02db28b"
server_key_iv: "f74dd6c668dcf4311cc0a28992692d2f"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.446951 22560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:58.458385 22560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:58.459193 22560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:58.459430 22560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:58.467567 22560 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:44301
I20260811 07:27:58.467573 22632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:44301 every 8 connection(s)
I20260811 07:27:58.468693 22560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:58.472034 22633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:58.473559 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22560
I20260811 07:27:58.473683 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:58.474103 12256 external_mini_cluster.cc:1428] Setting key 578a18994f9b599e0f75af248a0798a1
I20260811 07:27:58.478993 22633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b: Bootstrap starting.
I20260811 07:27:58.481693 22633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:58.482637 22633 log.cc:824] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:58.484545 22636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:58.475683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51348 (local address 127.11.248.62:44301)
0811 07:27:58.476400 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:58.476418 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:58.476456 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:27:58.477228 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:58.477247 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:58.477655 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:58.477982 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:58.478393 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.479526 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.480786 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.481397 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.481522 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:58.482460 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:58.482465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:58.482477 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:58.482983 (+ 506us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:58.483062 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:58.483092 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:58.483197 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:58.483352 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 07:27:58.483633 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":151,"threads_started":1}
I20260811 07:27:58.484999 22633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b: No bootstrap required, opened a new log
I20260811 07:27:58.488860 22633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58d56af479ff423d8714ed79c2083b8b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44301 } }
I20260811 07:27:58.489107 22633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:58.489166 22633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58d56af479ff423d8714ed79c2083b8b, State: Initialized, Role: FOLLOWER
I20260811 07:27:58.489624 22633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58d56af479ff423d8714ed79c2083b8b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44301 } }
I20260811 07:27:58.489784 22633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:58.489876 22633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:58.490000 22633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:58.491003 22633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58d56af479ff423d8714ed79c2083b8b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44301 } }
I20260811 07:27:58.491349 22633 leader_election.cc:302] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58d56af479ff423d8714ed79c2083b8b; no voters:
I20260811 07:27:58.491683 22633 leader_election.cc:288] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:58.491845 22638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:58.492138 22638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [term 1 LEADER]: Becoming Leader. State: Replica: 58d56af479ff423d8714ed79c2083b8b, State: Running, Role: LEADER
I20260811 07:27:58.492501 22638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58d56af479ff423d8714ed79c2083b8b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44301 } }
I20260811 07:27:58.493050 22633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:58.494336 22640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58d56af479ff423d8714ed79c2083b8b. Latest consensus state: current_term: 1 leader_uuid: "58d56af479ff423d8714ed79c2083b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58d56af479ff423d8714ed79c2083b8b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44301 } } }
I20260811 07:27:58.494377 22639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58d56af479ff423d8714ed79c2083b8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58d56af479ff423d8714ed79c2083b8b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44301 } } }
I20260811 07:27:58.494472 22640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:58.494488 22639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:58.494897 22647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:58.498090 22647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:58.504029 22647 catalog_manager.cc:1347] Generated new cluster ID: a62720f570a44cd28a5522400d2f02e4
I20260811 07:27:58.504125 22647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:58.544430 22647 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:58.545725 22647 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:58.556373 22647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58d56af479ff423d8714ed79c2083b8b: Generated new TSK 0
I20260811 07:27:58.557315 22647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:58.570633 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44301
--builtin_ntp_servers=127.11.248.20:43177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 07:27:58.704236 22657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:58.704527 22657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:58.704568 22657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:58.708724 22657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:58.708793 22657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:58.708917 22657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:58.713958 22657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:58.715193 22657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:58.716682 22657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:58.726990 22663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:58.726936 22665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:58.726981 22662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:58.727046 22657 server_base.cc:1034] running on GCE node
I20260811 07:27:58.727687 22657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:58.728400 22657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:58.729615 22657 hybrid_clock.cc:648] HybridClock initialized: now 1786433278729582 us; error 54 us; skew 500 ppm
I20260811 07:27:58.731585 22657 webserver.cc:460] Webserver started at http://127.11.248.1:33229/ using document root <none> and password file <none>
I20260811 07:27:58.732223 22657 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:58.732327 22657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:58.732571 22657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:58.735230 22657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "4d65b0e8225b4566a380b13321936231"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "0a7d7e72af63e812b916854c11ba55a1"
server_key_iv: "fccf5d07a7c8dfd56dd97cd045669d46"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.735865 22657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "4d65b0e8225b4566a380b13321936231"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "0a7d7e72af63e812b916854c11ba55a1"
server_key_iv: "fccf5d07a7c8dfd56dd97cd045669d46"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.740043 22657 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:27:58.743063 22671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.744534 22657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:27:58.744699 22657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "4d65b0e8225b4566a380b13321936231"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "0a7d7e72af63e812b916854c11ba55a1"
server_key_iv: "fccf5d07a7c8dfd56dd97cd045669d46"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.744872 22657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:58.776652 22657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:58.777520 22657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:58.777763 22657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:58.778424 22657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:58.779469 22657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:58.779548 22657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.779628 22657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:58.779685 22657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.789623 22657 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:46669
I20260811 07:27:58.789672 22796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:46669 every 8 connection(s)
I20260811 07:27:58.790637 22657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:58.800130 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22657
I20260811 07:27:58.800326 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:58.800678 12256 external_mini_cluster.cc:1428] Setting key 205754588549c238933caf663b907f8b
I20260811 07:27:58.801731 22636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:58.792669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:36209 (local address 127.11.248.62:44301)
0811 07:27:58.792837 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:58.792842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:58.794076 (+ 1234us) server_negotiation.cc:407] Connection header received
0811 07:27:58.795557 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:58.795561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:58.795621 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:58.795822 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:58.796925 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.797592 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.798865 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.799143 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.799251 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:58.801073 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:58.801077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:58.801079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:58.801093 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:58.801117 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:58.801126 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:58.801227 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:58.801479 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 07:27:58.801589 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:27:58.802759 22799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:58.793131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44301 (local address 127.11.248.1:36209)
0811 07:27:58.793911 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:58.793959 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:58.795285 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:58.795985 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:58.795992 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:58.796076 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:58.796611 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:58.796624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.797765 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.797769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:58.798685 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:58.798695 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:58.799303 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:58.799305 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:58.799492 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:58.800478 (+ 986us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:58.800480 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:58.800547 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:58.800642 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:58.801232 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:58.801246 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:58.801253 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:27:58.801459 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 07:27:58.801755 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":131,"threads_started":1}
I20260811 07:27:58.803010 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44301
--builtin_ntp_servers=127.11.248.20:43177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:27:58.804185 22797 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44301
I20260811 07:27:58.804420 22797 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:58.805020 22797 heartbeater.cc:511] Master 127.11.248.62:44301 requested a full tablet report, sending...
I20260811 07:27:58.806643 22595 ts_manager.cc:194] Registered new tserver with Master: 4d65b0e8225b4566a380b13321936231 (127.11.248.1:46669)
I20260811 07:27:58.807961 22595 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.1:36209
W20260811 07:27:58.920681 22800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:58.921049 22800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:58.921128 22800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:58.925719 22800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:58.925906 22800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:58.926007 22800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:58.931273 22800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:58.932505 22800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:58.934087 22800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:58.944929 22806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:58.944948 22805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:58.945178 22808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:58.944994 22800 server_base.cc:1034] running on GCE node
I20260811 07:27:58.945785 22800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:58.946678 22800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:58.947964 22800 hybrid_clock.cc:648] HybridClock initialized: now 1786433278947931 us; error 76 us; skew 500 ppm
I20260811 07:27:58.950848 22800 webserver.cc:460] Webserver started at http://127.11.248.2:39111/ using document root <none> and password file <none>
I20260811 07:27:58.951764 22800 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:58.951891 22800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:58.952216 22800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:58.954859 22800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "a987a6860e7b4831b0fb56403eb37e07"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "e74cef87e7573c6187fd58528e741633"
server_key_iv: "4f9b676303c33ce9eed027b0a66c1d59"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.955802 22800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "a987a6860e7b4831b0fb56403eb37e07"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "e74cef87e7573c6187fd58528e741633"
server_key_iv: "4f9b676303c33ce9eed027b0a66c1d59"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.960557 22800 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260811 07:27:58.963631 22814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.965342 22800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:27:58.965518 22800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "a987a6860e7b4831b0fb56403eb37e07"
format_stamp: "Formatted at 2026-08-11 07:27:58 on dist-test-slave-77v9"
server_key: "e74cef87e7573c6187fd58528e741633"
server_key_iv: "4f9b676303c33ce9eed027b0a66c1d59"
server_key_version: "encryptionkey@0"
I20260811 07:27:58.965659 22800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:58.983503 22800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:58.984459 22800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:58.984684 22800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:58.985411 22800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:58.986519 22800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:58.986573 22800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.986616 22800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:58.986658 22800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:58.996613 22800 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:37249
I20260811 07:27:58.996702 22936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:37249 every 8 connection(s)
I20260811 07:27:58.997641 22800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:59.001529 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22800
I20260811 07:27:59.001657 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:59.001976 12256 external_mini_cluster.cc:1428] Setting key cd66c5adcd7d164badd77278a45e3c19
I20260811 07:27:59.004206 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44301
--builtin_ntp_servers=127.11.248.20:43177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:27:59.009305 22636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:58.999528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:47437 (local address 127.11.248.62:44301)
0811 07:27:58.999700 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:58.999705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:59.001311 (+ 1606us) server_negotiation.cc:407] Connection header received
0811 07:27:59.003010 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:59.003013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:59.003060 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:59.003117 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:59.004165 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.005020 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.006797 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.007031 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.007115 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:59.008712 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:59.008716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:59.008718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:59.008731 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:59.008753 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:59.008762 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:59.008904 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:59.009076 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:27:59.009149 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:27:59.010293 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.000012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44301 (local address 127.11.248.2:47437)
0811 07:27:59.001114 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:59.001163 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:59.002761 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:59.003324 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:59.003337 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:59.003442 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:59.004006 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:59.004020 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.005186 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.005189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:59.006629 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:59.006646 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.007211 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.007218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:59.007468 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:59.008325 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:59.008327 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:59.008404 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:59.008505 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:59.008905 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:59.008918 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:59.008926 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:27:59.009076 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 07:27:59.009413 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":125,"threads_started":1}
I20260811 07:27:59.011725 22937 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44301
I20260811 07:27:59.012050 22937 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:59.012678 22937 heartbeater.cc:511] Master 127.11.248.62:44301 requested a full tablet report, sending...
I20260811 07:27:59.014042 22595 ts_manager.cc:194] Registered new tserver with Master: a987a6860e7b4831b0fb56403eb37e07 (127.11.248.2:37249)
I20260811 07:27:59.014976 22595 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.2:47437
W20260811 07:27:59.125700 22940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:59.125988 22940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:59.126027 22940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:59.130164 22940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:59.130239 22940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:59.130295 22940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:27:59.135316 22940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:59.136462 22940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:59.137948 22940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:59.148334 22945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:59.148216 22948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:59.148242 22946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:59.148864 22940 server_base.cc:1034] running on GCE node
I20260811 07:27:59.149343 22940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:59.150168 22940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:59.151373 22940 hybrid_clock.cc:648] HybridClock initialized: now 1786433279151345 us; error 44 us; skew 500 ppm
I20260811 07:27:59.153587 22940 webserver.cc:460] Webserver started at http://127.11.248.3:37709/ using document root <none> and password file <none>
I20260811 07:27:59.154217 22940 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:59.154318 22940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:59.154547 22940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:59.156734 22940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "749d244d514d44aaac6255c006c33d88"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "6eaa9e53c4d70d87cca5d4a2fad97d00"
server_key_iv: "b774e6f25302daa029dbdacbdac06352"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.157449 22940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "749d244d514d44aaac6255c006c33d88"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "6eaa9e53c4d70d87cca5d4a2fad97d00"
server_key_iv: "b774e6f25302daa029dbdacbdac06352"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.161635 22940 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:27:59.164330 22954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.165635 22940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:27:59.165784 22940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "749d244d514d44aaac6255c006c33d88"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "6eaa9e53c4d70d87cca5d4a2fad97d00"
server_key_iv: "b774e6f25302daa029dbdacbdac06352"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.165920 22940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:59.186880 22940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:59.187656 22940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:59.187873 22940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:59.188500 22940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:59.189556 22940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:59.189631 22940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.189706 22940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:59.189760 22940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.199079 22940 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39035
I20260811 07:27:59.199204 23081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39035 every 8 connection(s)
I20260811 07:27:59.200141 22940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:27:59.203078 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 22940
I20260811 07:27:59.203246 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:27:59.203580 12256 external_mini_cluster.cc:1428] Setting key 4480b479eefd27ade68ffe88d0f3572a
I20260811 07:27:59.210655 22636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.202233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:57019 (local address 127.11.248.62:44301)
0811 07:27:59.202400 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:59.202404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:59.203581 (+ 1177us) server_negotiation.cc:407] Connection header received
0811 07:27:59.205450 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:59.205454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:59.205516 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:59.205615 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:59.206620 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.207313 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.208670 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.209006 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.209099 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:59.210220 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:59.210223 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:59.210225 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:59.210238 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:59.210257 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:59.210265 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:59.210325 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:59.210488 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 07:27:59.210542 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:27:59.211606 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.202632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44301 (local address 127.11.248.3:57019)
0811 07:27:59.203414 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:59.203469 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:59.205169 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:59.205774 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:59.205781 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:59.205865 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:59.206479 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:59.206495 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.207476 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.207480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:59.208527 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:27:59.208537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:27:59.209161 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:27:59.209164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:27:59.209342 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:27:59.209959 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:59.209960 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:59.210004 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:59.210072 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:59.210356 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:59.210363 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:59.210367 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:27:59.210470 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:27:59.210704 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":164,"threads_started":1}
I20260811 07:27:59.213001 23083 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44301
I20260811 07:27:59.213238 23083 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:59.213842 23083 heartbeater.cc:511] Master 127.11.248.62:44301 requested a full tablet report, sending...
I20260811 07:27:59.214944 22595 ts_manager.cc:194] Registered new tserver with Master: 749d244d514d44aaac6255c006c33d88 (127.11.248.3:39035)
I20260811 07:27:59.215535 22595 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.3:57019
I20260811 07:27:59.218101 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:27:59.221091 22636 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:27:59.220166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43888 (local address 127.11.248.62:44301)
0811 07:27:59.220352 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:59.220357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:59.220492 (+ 135us) server_negotiation.cc:407] Connection header received
0811 07:27:59.220592 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:59.220594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:59.220633 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:59.220696 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:59.220986 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43888: BlockingRecv error: recv got EOF from 127.0.0.1:43888 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:27:59.221405 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22657
I20260811 07:27:59.231281 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22800
I20260811 07:27:59.238876 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22940
I20260811 07:27:59.245752 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 22560
2026-08-11T07:27:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (994 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T07:27:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:27:59Z Disabled control of system clock
I20260811 07:27:59.279459 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41671
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:41671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:27:59.400466 23095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:59.400904 23095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:59.400969 23095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:59.405277 23095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:27:59.405375 23095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:59.405393 23095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:59.405414 23095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:27:59.405433 23095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:27:59.410738 23095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:41671
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:59.412003 23095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:59.413604 23095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:59.423292 23100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:59.423359 23095 server_base.cc:1034] running on GCE node
W20260811 07:27:59.423308 23103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:59.423311 23101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:59.424206 23095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:59.425621 23095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:59.426816 23095 hybrid_clock.cc:648] HybridClock initialized: now 1786433279426780 us; error 55 us; skew 500 ppm
I20260811 07:27:59.429720 23095 webserver.cc:460] Webserver started at http://127.11.248.62:46709/ using document root <none> and password file <none>
I20260811 07:27:59.430482 23095 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:59.430600 23095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:59.430858 23095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:59.434142 23095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "2f9f68ce152b46d6a48a06f47ee26f0c"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "887884c554305ba151ea6dac89c3b995"
server_key_iv: "802726c8c94974fc8d16ca56d717c7d7"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.434799 23095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "2f9f68ce152b46d6a48a06f47ee26f0c"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "887884c554305ba151ea6dac89c3b995"
server_key_iv: "802726c8c94974fc8d16ca56d717c7d7"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.439976 23095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:27:59.442905 23112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.444382 23095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:27:59.444543 23095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "2f9f68ce152b46d6a48a06f47ee26f0c"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "887884c554305ba151ea6dac89c3b995"
server_key_iv: "802726c8c94974fc8d16ca56d717c7d7"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.444682 23095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:59.449934 23095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:59.450657 23095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:59.450875 23095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:59.458768 23095 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:41671
I20260811 07:27:59.458777 23165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:41671 every 8 connection(s)
I20260811 07:27:59.460214 23095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:27:59.463979 23166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:27:59.466760 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23095
I20260811 07:27:59.466882 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:27:59.467198 12256 external_mini_cluster.cc:1428] Setting key a252aeef7e1a718b7bc04786a3e993bf
I20260811 07:27:59.470782 23166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c: Bootstrap starting.
I20260811 07:27:59.473604 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.468924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60484 (local address 127.11.248.62:41671)
0811 07:27:59.469619 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:59.469636 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:59.469676 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:27:59.470398 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:59.470417 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:59.470806 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:59.471169 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:59.472113 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:59.472117 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:59.472130 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:59.472143 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:59.472203 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:59.472220 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:59.472348 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:59.472492 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 07:27:59.472789 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":153,"threads_started":1}
I20260811 07:27:59.473659 23166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c: Neither blocks nor log segments found. Creating new log.
I20260811 07:27:59.474659 23166 log.cc:824] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:27:59.477237 23166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c: No bootstrap required, opened a new log
I20260811 07:27:59.481807 23166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41671 } }
I20260811 07:27:59.482129 23166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:27:59.482219 23166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f9f68ce152b46d6a48a06f47ee26f0c, State: Initialized, Role: FOLLOWER
I20260811 07:27:59.482734 23166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41671 } }
I20260811 07:27:59.482950 23166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:27:59.483048 23166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:27:59.483165 23166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:27:59.484273 23166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41671 } }
I20260811 07:27:59.484676 23166 leader_election.cc:302] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f9f68ce152b46d6a48a06f47ee26f0c; no voters:
I20260811 07:27:59.485080 23166 leader_election.cc:288] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:27:59.485230 23171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:27:59.485503 23171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [term 1 LEADER]: Becoming Leader. State: Replica: 2f9f68ce152b46d6a48a06f47ee26f0c, State: Running, Role: LEADER
I20260811 07:27:59.485849 23171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41671 } }
I20260811 07:27:59.486498 23166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:27:59.487711 23172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41671 } } }
I20260811 07:27:59.487880 23172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:59.487711 23173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f9f68ce152b46d6a48a06f47ee26f0c. Latest consensus state: current_term: 1 leader_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f9f68ce152b46d6a48a06f47ee26f0c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41671 } } }
I20260811 07:27:59.488108 23173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c [sys.catalog]: This master's current role is: LEADER
I20260811 07:27:59.489172 23182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:27:59.492681 23182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:27:59.499056 23182 catalog_manager.cc:1347] Generated new cluster ID: 1b21da9db1924d2996c5cabe6a2b53c2
I20260811 07:27:59.499156 23182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:27:59.515313 23182 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:27:59.515764 23182 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:27:59.524290 23182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f9f68ce152b46d6a48a06f47ee26f0c: Generated new TSK 0
I20260811 07:27:59.525275 23182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:27:59.536283 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41671
--builtin_ntp_servers=127.11.248.20:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:27:59.658594 23193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:59.658907 23193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:59.658955 23193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:59.663369 23193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:59.663453 23193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:59.663559 23193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:27:59.668532 23193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:59.669798 23193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:59.671275 23193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:59.681499 23199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:59.681726 23193 server_base.cc:1034] running on GCE node
W20260811 07:27:59.681555 23201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:59.681501 23205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:59.682319 23193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:59.682940 23193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:59.684151 23193 hybrid_clock.cc:648] HybridClock initialized: now 1786433279684138 us; error 26 us; skew 500 ppm
I20260811 07:27:59.686192 23193 webserver.cc:460] Webserver started at http://127.11.248.1:33241/ using document root <none> and password file <none>
I20260811 07:27:59.686895 23193 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:59.687002 23193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:59.687256 23193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:59.689600 23193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "5fd24100460044a6976914cda4be8c7f"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "5c1927bce9c7edb4c500909470e0f8bd"
server_key_iv: "a65e6f2d63a4dcafb25a5d6cbd7b256a"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.690210 23193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "5fd24100460044a6976914cda4be8c7f"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "5c1927bce9c7edb4c500909470e0f8bd"
server_key_iv: "a65e6f2d63a4dcafb25a5d6cbd7b256a"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.694250 23193 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:59.697247 23212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.698673 23193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:27:59.698923 23193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "5fd24100460044a6976914cda4be8c7f"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "5c1927bce9c7edb4c500909470e0f8bd"
server_key_iv: "a65e6f2d63a4dcafb25a5d6cbd7b256a"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.699077 23193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:59.704344 23193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:59.705124 23193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:59.705370 23193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:59.706000 23193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:59.707072 23193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:59.707155 23193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.707235 23193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:59.707294 23193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.718092 23193 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:39887
I20260811 07:27:59.718123 23330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:39887 every 8 connection(s)
I20260811 07:27:59.719154 23193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:27:59.724720 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23193
I20260811 07:27:59.724903 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:27:59.725278 12256 external_mini_cluster.cc:1428] Setting key 76330d96c3edc79eef2ababe5acad297
I20260811 07:27:59.726161 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.721210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:54211 (local address 127.11.248.62:41671)
0811 07:27:59.721355 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:59.721360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:59.722460 (+ 1100us) server_negotiation.cc:407] Connection header received
0811 07:27:59.723866 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:59.723870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:59.723923 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:59.724047 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:59.725598 (+ 1551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:59.725602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:59.725604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:59.725619 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:59.725644 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:59.725654 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:59.725822 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:59.725980 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 07:27:59.726040 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:27:59.727337 23333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.721604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41671 (local address 127.11.248.1:54211)
0811 07:27:59.722292 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:59.722336 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:59.723622 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:59.724236 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:59.724243 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:59.724333 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:59.725233 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:59.725236 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:59.725293 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:59.725393 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:59.725800 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:59.725809 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:59.725814 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:27:59.726004 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 07:27:59.726300 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":132,"threads_started":1}
I20260811 07:27:59.727706 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41671
--builtin_ntp_servers=127.11.248.20:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:27:59.728950 23331 heartbeater.cc:347] Connected to a master server at 127.11.248.62:41671
I20260811 07:27:59.729218 23331 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:59.729771 23331 heartbeater.cc:511] Master 127.11.248.62:41671 requested a full tablet report, sending...
I20260811 07:27:59.731594 23127 ts_manager.cc:194] Registered new tserver with Master: 5fd24100460044a6976914cda4be8c7f (127.11.248.1:39887)
W20260811 07:27:59.846525 23334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:27:59.846839 23334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:27:59.846882 23334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:27:59.851122 23334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:27:59.851195 23334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:27:59.851260 23334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:27:59.856227 23334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:27:59.857457 23334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:27:59.858911 23334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:27:59.869329 23343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:59.869328 23340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:27:59.869336 23341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:27:59.869722 23334 server_base.cc:1034] running on GCE node
I20260811 07:27:59.870149 23334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:27:59.870910 23334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:27:59.872112 23334 hybrid_clock.cc:648] HybridClock initialized: now 1786433279872091 us; error 42 us; skew 500 ppm
I20260811 07:27:59.874287 23334 webserver.cc:460] Webserver started at http://127.11.248.2:44541/ using document root <none> and password file <none>
I20260811 07:27:59.874917 23334 fs_manager.cc:359] Metadata directory not provided
I20260811 07:27:59.875036 23334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:27:59.875285 23334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:27:59.877594 23334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "0dee02bc0c3c4901ac849da1461b328c"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "6bfc6d22d398ed0674957f174db060fe"
server_key_iv: "2bb3ffaa5aaa25badbc19985f6bf8dc2"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.878238 23334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "0dee02bc0c3c4901ac849da1461b328c"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "6bfc6d22d398ed0674957f174db060fe"
server_key_iv: "2bb3ffaa5aaa25badbc19985f6bf8dc2"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.882200 23334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:27:59.885128 23353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.886571 23334 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:27:59.886714 23334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "0dee02bc0c3c4901ac849da1461b328c"
format_stamp: "Formatted at 2026-08-11 07:27:59 on dist-test-slave-77v9"
server_key: "6bfc6d22d398ed0674957f174db060fe"
server_key_iv: "2bb3ffaa5aaa25badbc19985f6bf8dc2"
server_key_version: "encryptionkey@0"
I20260811 07:27:59.886849 23334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:27:59.891845 23334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:27:59.892531 23334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:27:59.892741 23334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:27:59.893376 23334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:27:59.894368 23334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:27:59.894446 23334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.894517 23334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:27:59.894567 23334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:27:59.904088 23334 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:33109
I20260811 07:27:59.904121 23474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:33109 every 8 connection(s)
I20260811 07:27:59.905148 23334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:27:59.906782 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23334
I20260811 07:27:59.906931 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:27:59.907262 12256 external_mini_cluster.cc:1428] Setting key 41d64708f9b2c72c5ebf553d679a4ad4
I20260811 07:27:59.909900 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41671
--builtin_ntp_servers=127.11.248.20:43805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:27:59.912644 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.907237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:60707 (local address 127.11.248.62:41671)
0811 07:27:59.907421 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:27:59.907426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:27:59.908967 (+ 1541us) server_negotiation.cc:407] Connection header received
0811 07:27:59.910637 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:27:59.910643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:27:59.910695 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:27:59.910796 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:27:59.912138 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:27:59.912142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:27:59.912145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:27:59.912158 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:27:59.912189 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:27:59.912198 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:27:59.912300 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:27:59.912457 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 07:27:59.912508 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:27:59.913571 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:27:59.907785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41671 (local address 127.11.248.2:60707)
0811 07:27:59.908769 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0811 07:27:59.908864 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0811 07:27:59.910409 (+ 1545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:27:59.911036 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:27:59.911044 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:27:59.911137 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:27:59.911847 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:27:59.911849 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:27:59.911910 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:27:59.911981 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:27:59.912285 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:27:59.912294 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:27:59.912300 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:27:59.912491 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 07:27:59.912741 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":152,"threads_started":1}
I20260811 07:27:59.914839 23475 heartbeater.cc:347] Connected to a master server at 127.11.248.62:41671
I20260811 07:27:59.915107 23475 heartbeater.cc:464] Registering TS with master...
I20260811 07:27:59.915576 23475 heartbeater.cc:511] Master 127.11.248.62:41671 requested a full tablet report, sending...
I20260811 07:27:59.916782 23127 ts_manager.cc:194] Registered new tserver with Master: 0dee02bc0c3c4901ac849da1461b328c (127.11.248.2:33109)
W20260811 07:28:00.029732 23479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:00.030042 23479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:00.030084 23479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:00.034278 23479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:00.034348 23479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:00.034410 23479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:28:00.039368 23479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:43805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:41671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:00.040506 23479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:00.042006 23479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:00.052357 23485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:00.052357 23486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:00.052577 23479 server_base.cc:1034] running on GCE node
W20260811 07:28:00.052350 23488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:00.053246 23479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:00.053961 23479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:00.055184 23479 hybrid_clock.cc:648] HybridClock initialized: now 1786433280055160 us; error 49 us; skew 500 ppm
I20260811 07:28:00.057544 23479 webserver.cc:460] Webserver started at http://127.11.248.3:38605/ using document root <none> and password file <none>
I20260811 07:28:00.058212 23479 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:00.058327 23479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:00.058590 23479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:28:00.060998 23479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "492a8b0d3dfd4d77a5542f11a4acdc1d"
format_stamp: "Formatted at 2026-08-11 07:28:00 on dist-test-slave-77v9"
server_key: "b29051a835c71bcb9c50397ccde7f529"
server_key_iv: "a95edce57db2a3d79f4fcaa5ed910df8"
server_key_version: "encryptionkey@0"
I20260811 07:28:00.061646 23479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "492a8b0d3dfd4d77a5542f11a4acdc1d"
format_stamp: "Formatted at 2026-08-11 07:28:00 on dist-test-slave-77v9"
server_key: "b29051a835c71bcb9c50397ccde7f529"
server_key_iv: "a95edce57db2a3d79f4fcaa5ed910df8"
server_key_version: "encryptionkey@0"
I20260811 07:28:00.065893 23479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:28:00.068642 23498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:00.070122 23479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:28:00.070297 23479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "492a8b0d3dfd4d77a5542f11a4acdc1d"
format_stamp: "Formatted at 2026-08-11 07:28:00 on dist-test-slave-77v9"
server_key: "b29051a835c71bcb9c50397ccde7f529"
server_key_iv: "a95edce57db2a3d79f4fcaa5ed910df8"
server_key_version: "encryptionkey@0"
I20260811 07:28:00.070441 23479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:00.075908 23479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:00.076592 23479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:00.076803 23479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:00.077507 23479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:00.078613 23479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:00.078687 23479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:00.078760 23479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:00.078812 23479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:00.088557 23479 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:44433
I20260811 07:28:00.088574 23623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:44433 every 8 connection(s)
I20260811 07:28:00.089633 23479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:28:00.096338 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:00.091624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:58175 (local address 127.11.248.62:41671)
0811 07:28:00.091776 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:00.091779 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:00.092863 (+ 1084us) server_negotiation.cc:407] Connection header received
0811 07:28:00.094259 (+ 1396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:00.094263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:00.094325 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:00.094438 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:00.095689 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:00.095694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:00.095703 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:28:00.095717 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:00.095741 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:28:00.095752 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:00.095889 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:00.096089 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:28:00.096145 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:28:00.097402 23626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:00.092024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41671 (local address 127.11.248.3:58175)
0811 07:28:00.092684 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:00.092726 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:00.094022 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:00.094616 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:00.094623 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:00.094714 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:00.095337 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:28:00.095339 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:00.095384 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:28:00.095475 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:00.095890 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:00.095903 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:00.095914 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:28:00.096137 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 07:28:00.096412 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
I20260811 07:28:00.098536 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23479
I20260811 07:28:00.098657 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:28:00.098958 23624 heartbeater.cc:347] Connected to a master server at 127.11.248.62:41671
I20260811 07:28:00.098989 12256 external_mini_cluster.cc:1428] Setting key 98ba7b821fed31e1b67a1356e7cddf03
I20260811 07:28:00.099279 23624 heartbeater.cc:464] Registering TS with master...
I20260811 07:28:00.099774 23624 heartbeater.cc:511] Master 127.11.248.62:41671 requested a full tablet report, sending...
I20260811 07:28:00.101120 23129 ts_manager.cc:194] Registered new tserver with Master: 492a8b0d3dfd4d77a5542f11a4acdc1d (127.11.248.3:44433)
I20260811 07:28:00.113709 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:28:00.116917 23169 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:28:00.115834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60496 (local address 127.11.248.62:41671)
0811 07:28:00.116028 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:00.116034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:00.116172 (+ 138us) server_negotiation.cc:407] Connection header received
0811 07:28:00.116340 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:00.116343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:00.116385 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:00.116473 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:00.116740 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60496: BlockingRecv error: recv got EOF from 127.0.0.1:60496 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:28:00.117466 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23193
I20260811 07:28:00.127604 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23334
I20260811 07:28:00.138204 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23479
I20260811 07:28:00.147656 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23095
2026-08-11T07:28:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (902 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:28:00 dist-test-slave-77v9 krb5kdc[23635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:28:00 dist-test-slave-77v9 krb5kdc[23635](info): set up 2 sockets
Aug 11 07:28:00 dist-test-slave-77v9 krb5kdc[23635](info): commencing operation
krb5kdc: starting...
W20260811 07:28:01.280417 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:28:01 dist-test-slave-77v9 krb5kdc[23635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:28:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:28:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:28:01.424716 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:37977
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:37977
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:01.548939 23651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:01.549307 23651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:01.549403 23651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:01.553674 23651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:28:01.553789 23651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:01.553830 23651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:01.553869 23651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:28:01.553905 23651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:28:01.559428 23651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:37977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:37977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:01.560632 23651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:01.561758 23651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:01.571100 23659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:01.571185 23651 server_base.cc:1034] running on GCE node
W20260811 07:28:01.571084 23656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:01.571077 23657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:01.572139 23651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:01.573392 23651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:01.574561 23651 hybrid_clock.cc:648] HybridClock initialized: now 1786433281574489 us; error 89 us; skew 500 ppm
Aug 11 07:28:01 dist-test-slave-77v9 krb5kdc[23635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433281, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:01.577943 23651 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:28:01.578948 23651 webserver.cc:460] Webserver started at http://127.11.248.62:40197/ using document root <none> and password file <none>
I20260811 07:28:01.579553 23651 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:01.579620 23651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:01.579859 23651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:28:01.582126 23651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f"
format_stamp: "Formatted at 2026-08-11 07:28:01 on dist-test-slave-77v9"
server_key: "1e706fa77cff6a6bef47372e15219c45"
server_key_iv: "7d7f93bd74548733ed890d69bcea323d"
server_key_version: "encryptionkey@0"
I20260811 07:28:01.582755 23651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f"
format_stamp: "Formatted at 2026-08-11 07:28:01 on dist-test-slave-77v9"
server_key: "1e706fa77cff6a6bef47372e15219c45"
server_key_iv: "7d7f93bd74548733ed890d69bcea323d"
server_key_version: "encryptionkey@0"
I20260811 07:28:01.587091 23651 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 07:28:01.590139 23669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:01.591454 23651 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:28:01.591606 23651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f"
format_stamp: "Formatted at 2026-08-11 07:28:01 on dist-test-slave-77v9"
server_key: "1e706fa77cff6a6bef47372e15219c45"
server_key_iv: "7d7f93bd74548733ed890d69bcea323d"
server_key_version: "encryptionkey@0"
I20260811 07:28:01.591735 23651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:01.624102 23651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:01.627427 23651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:01.627604 23651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:01.635361 23651 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:37977
I20260811 07:28:01.635776 23725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:37977 every 8 connection(s)
I20260811 07:28:01.636444 23651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:28:01.639547 23726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:01.645440 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23651
I20260811 07:28:01.645629 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:28:01.646014 12256 external_mini_cluster.cc:1428] Setting key 345a458d56d54041c56d1d043f0bb66f
I20260811 07:28:01.645992 23726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: Bootstrap starting.
I20260811 07:28:01.649065 23726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:01.649940 23726 log.cc:824] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:01.652156 23726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: No bootstrap required, opened a new log
Aug 11 07:28:01 dist-test-slave-77v9 krb5kdc[23635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:01.656560 23726 raft_consensus.cc:348] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 37977 } }
I20260811 07:28:01.657042 23726 raft_consensus.cc:374] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:01.657143 23726 raft_consensus.cc:729] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a53fba8bc44a4c6ca4b60ad1df9c595f, State: Initialized, Role: FOLLOWER
I20260811 07:28:01.657753 23726 consensus_queue.cc:260] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 37977 } }
I20260811 07:28:01.657948 23726 raft_consensus.cc:388] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:28:01.658053 23726 raft_consensus.cc:482] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:28:01.658178 23726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:01.659313 23726 raft_consensus.cc:504] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 37977 } }
I20260811 07:28:01.659816 23726 leader_election.cc:302] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a53fba8bc44a4c6ca4b60ad1df9c595f; no voters:
I20260811 07:28:01.660444 23726 leader_election.cc:288] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:28:01.660574 23732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:28:01.660945 23732 raft_consensus.cc:686] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [term 1 LEADER]: Becoming Leader. State: Replica: a53fba8bc44a4c6ca4b60ad1df9c595f, State: Running, Role: LEADER
I20260811 07:28:01.661383 23732 consensus_queue.cc:237] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 37977 } }
I20260811 07:28:01.662132 23726 sys_catalog.cc:564] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:28:01.662741 23732 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a53fba8bc44a4c6ca4b60ad1df9c595f. Latest consensus state: current_term: 1 leader_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 37977 } } }
I20260811 07:28:01.662904 23730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:01.647531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.11.248.62:37977)
0811 07:28:01.648099 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:01.648115 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:01.648155 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:28:01.648980 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:01.649001 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:01.649410 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:01.649773 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:01.650709 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:01.651723 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:01.652702 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:01.653274 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:01.653463 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:01.656552 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:01.656558 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:01.656574 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:01.656610 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:01.658754 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:01.659265 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:01.659279 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:01.659284 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:01.659421 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:01.659835 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:01.659838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:01.659839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:01.660751 (+ 912us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:01.661043 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:01.661362 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 07:28:01.661877 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":180,"threads_started":1}
I20260811 07:28:01.663676 23732 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [sys.catalog]: This master's current role is: LEADER
I20260811 07:28:01.663549 23733 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53fba8bc44a4c6ca4b60ad1df9c595f" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 37977 } } }
I20260811 07:28:01.663887 23733 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f [sys.catalog]: This master's current role is: LEADER
W20260811 07:28:01.667361 23747 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:28:01.667440 23747 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:28:01.667531 23741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:28:01.668268 23741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:28:01.674739 23741 catalog_manager.cc:1347] Generated new cluster ID: 00aaca288b524beba71d109a735f9ef8
I20260811 07:28:01.674834 23741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:28:01.699785 23741 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:28:01.701095 23741 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:28:01.720422 23741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: Generated new TSK 0
I20260811 07:28:01.721413 23741 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:28:01.764878 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:37977
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:01.885919 23757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:01.886241 23757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:01.886291 23757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:01.890645 23757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:01.890749 23757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:01.890815 23757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:28:01.896590 23757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:37977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:01.897878 23757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:01.899022 23757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:01.909795 23764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:01.909827 23763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:01.909898 23766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:01.910380 23757 server_base.cc:1034] running on GCE node
I20260811 07:28:01.910838 23757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:01.911717 23757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:01.912905 23757 hybrid_clock.cc:648] HybridClock initialized: now 1786433281912867 us; error 52 us; skew 500 ppm
Aug 11 07:28:01 dist-test-slave-77v9 krb5kdc[23635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433281, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:01.916292 23757 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:28:01.917439 23757 webserver.cc:460] Webserver started at http://127.11.248.1:40751/ using document root <none> and password file <none>
I20260811 07:28:01.918090 23757 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:01.918164 23757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:01.918416 23757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:28:01.921032 23757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "975b24d6f2e5437bb0456c42d5ca1335"
format_stamp: "Formatted at 2026-08-11 07:28:01 on dist-test-slave-77v9"
server_key: "9c2bc08142ebd6eefa183978d8a90742"
server_key_iv: "dadf89b33dc965a4d2ce07c290437ff9"
server_key_version: "encryptionkey@0"
I20260811 07:28:01.921736 23757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "975b24d6f2e5437bb0456c42d5ca1335"
format_stamp: "Formatted at 2026-08-11 07:28:01 on dist-test-slave-77v9"
server_key: "9c2bc08142ebd6eefa183978d8a90742"
server_key_iv: "dadf89b33dc965a4d2ce07c290437ff9"
server_key_version: "encryptionkey@0"
I20260811 07:28:01.926333 23757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:28:01.929438 23773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:01.930867 23757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:28:01.931044 23757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "975b24d6f2e5437bb0456c42d5ca1335"
format_stamp: "Formatted at 2026-08-11 07:28:01 on dist-test-slave-77v9"
server_key: "9c2bc08142ebd6eefa183978d8a90742"
server_key_iv: "dadf89b33dc965a4d2ce07c290437ff9"
server_key_version: "encryptionkey@0"
I20260811 07:28:01.931180 23757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:01.958623 23757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:01.962502 23757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:01.962734 23757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:01.963503 23757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:01.964537 23757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:01.964608 23757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:01.964677 23757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:01.964709 23757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:01.974786 23757 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:36063
I20260811 07:28:01.974818 23900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:36063 every 8 connection(s)
I20260811 07:28:01.975767 23757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:28:01.984493 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23757
I20260811 07:28:01.984627 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:28:01.985069 12256 external_mini_cluster.cc:1428] Setting key b601eaab68c1fcc4d0321352f2832d68
Aug 11 07:28:01 dist-test-slave-77v9 krb5kdc[23635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433281, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:01.991794 23730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:01.978011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:57457 (local address 127.11.248.62:37977)
0811 07:28:01.978168 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:01.978173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:01.979132 (+ 959us) server_negotiation.cc:407] Connection header received
0811 07:28:01.980602 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:01.980606 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:01.980672 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:01.980794 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:01.982110 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:01.982685 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:01.983943 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:01.984202 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:01.984333 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:01.987482 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:01.987486 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:01.987489 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:01.987529 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:01.989332 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:01.989988 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:01.989993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:01.989995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:01.990089 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:01.990495 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:01.990501 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:01.990505 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:01.990726 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:01.990851 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:01.991443 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 07:28:01.991598 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:28:01.992924 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:01.978432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:37977 (local address 127.11.248.1:57457)
0811 07:28:01.978965 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:01.979012 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:01.980362 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:01.981009 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:01.981016 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:01.981420 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:01.981938 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:01.981952 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:01.982840 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:01.982844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:01.983788 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:01.983798 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:01.984405 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:01.984410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:01.984622 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:01.985473 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:28:01.985490 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:01.987283 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:01.989485 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:01.989493 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:01.989520 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:01.989863 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:01.990196 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:01.990200 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:01.990202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:01.990379 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:01.990867 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:01.990877 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:01.991165 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 07:28:01.991396 (+ 231us) client_negotiation.cc:240] Negotiation successful
0811 07:28:01.991798 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":147,"threads_started":1}
I20260811 07:28:01.994750 23901 heartbeater.cc:347] Connected to a master server at 127.11.248.62:37977
I20260811 07:28:01.995047 23901 heartbeater.cc:464] Registering TS with master...
I20260811 07:28:01.995653 23901 heartbeater.cc:511] Master 127.11.248.62:37977 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:28:01.997705 23687 ts_manager.cc:194] Registered new tserver with Master: 975b24d6f2e5437bb0456c42d5ca1335 (127.11.248.1:36063)
I20260811 07:28:01.999114 23687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:57457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:28:02.021610 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:37977
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:02.141022 23906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:02.141418 23906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:02.141525 23906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:02.146301 23906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:02.146431 23906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:02.146552 23906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:28:02.152166 23906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:37977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:02.153393 23906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:02.154464 23906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:02.164469 23913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:02.164498 23912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:02.164469 23916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:02.164901 23906 server_base.cc:1034] running on GCE node
I20260811 07:28:02.165277 23906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:02.165983 23906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:02.167176 23906 hybrid_clock.cc:648] HybridClock initialized: now 1786433282167138 us; error 46 us; skew 500 ppm
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[23635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:02.170147 23906 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:28:02.171080 23906 webserver.cc:460] Webserver started at http://127.11.248.2:42991/ using document root <none> and password file <none>
I20260811 07:28:02.171654 23906 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:02.171720 23906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:02.171970 23906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:28:02.174081 23906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28"
format_stamp: "Formatted at 2026-08-11 07:28:02 on dist-test-slave-77v9"
server_key: "415ced3c415c7f0cf4a402fbb9399945"
server_key_iv: "73216760d1ae22d3969615c2defb27d3"
server_key_version: "encryptionkey@0"
I20260811 07:28:02.174665 23906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28"
format_stamp: "Formatted at 2026-08-11 07:28:02 on dist-test-slave-77v9"
server_key: "415ced3c415c7f0cf4a402fbb9399945"
server_key_iv: "73216760d1ae22d3969615c2defb27d3"
server_key_version: "encryptionkey@0"
I20260811 07:28:02.178423 23906 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 07:28:02.180934 23924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:02.182139 23906 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 07:28:02.182268 23906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28"
format_stamp: "Formatted at 2026-08-11 07:28:02 on dist-test-slave-77v9"
server_key: "415ced3c415c7f0cf4a402fbb9399945"
server_key_iv: "73216760d1ae22d3969615c2defb27d3"
server_key_version: "encryptionkey@0"
I20260811 07:28:02.182381 23906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:02.196522 23906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:02.200304 23906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:02.200555 23906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:02.201342 23906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:02.202284 23906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:02.202337 23906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:02.202379 23906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:02.202438 23906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:02.212283 23906 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:38055
I20260811 07:28:02.212308 24048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:38055 every 8 connection(s)
I20260811 07:28:02.213291 23906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:28:02.220479 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 23906
I20260811 07:28:02.220623 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:28:02.220965 12256 external_mini_cluster.cc:1428] Setting key 6b76c7166b765526de8e28d19313b36f
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[23635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:02.228974 23730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.215260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:35979 (local address 127.11.248.62:37977)
0811 07:28:02.215419 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.215422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.216255 (+ 833us) server_negotiation.cc:407] Connection header received
0811 07:28:02.217797 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.217800 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.217865 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.217979 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:02.219207 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.219854 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.221367 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.221606 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.221723 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.224585 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:02.224592 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:02.224598 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:02.224636 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:02.226309 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:02.226995 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:02.226998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:02.226999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:02.227079 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:02.227568 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:02.227573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:02.227575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:02.227841 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:02.227935 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.228652 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.228786 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:28:02.230317 24053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.215623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:37977 (local address 127.11.248.2:35979)
0811 07:28:02.216095 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.216140 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.217555 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.218157 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.218164 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.218553 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:02.219044 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.219057 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.219993 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.219998 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.221211 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.221222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.221770 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.221774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.221972 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.222642 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:28:02.222659 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:02.224384 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:02.226441 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:02.226450 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:02.226483 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:02.226875 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:02.227182 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:02.227188 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:02.227193 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:02.227412 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:02.227969 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:02.227979 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:02.228350 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.228599 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.229060 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":108,"threads_started":1}
I20260811 07:28:02.231678 24049 heartbeater.cc:347] Connected to a master server at 127.11.248.62:37977
I20260811 07:28:02.231962 24049 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:28:02.232558 24049 heartbeater.cc:511] Master 127.11.248.62:37977 requested a full tablet report, sending...
I20260811 07:28:02.233786 23687 ts_manager.cc:194] Registered new tserver with Master: 6beda7ac3bc84b8b801f4a45fa6a7b28 (127.11.248.2:38055)
I20260811 07:28:02.234416 23687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:35979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:28:02.252347 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:37977
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:02.371721 24056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:02.371997 24056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:02.372043 24056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:02.376313 24056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:02.376394 24056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:02.376485 24056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:28:02.382068 24056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:37977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:02.383227 24056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:02.384375 24056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:02.394750 24062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:02.394769 24065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:02.394765 24063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:02.395287 24056 server_base.cc:1034] running on GCE node
I20260811 07:28:02.395808 24056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:02.396584 24056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:02.397789 24056 hybrid_clock.cc:648] HybridClock initialized: now 1786433282397787 us; error 74 us; skew 500 ppm
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[23635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:02.400951 24056 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:28:02.401952 24056 webserver.cc:460] Webserver started at http://127.11.248.3:41453/ using document root <none> and password file <none>
I20260811 07:28:02.402601 24056 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:02.402668 24056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:02.402892 24056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:28:02.405097 24056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "1dc46f0680534442ab73652f5cc60179"
format_stamp: "Formatted at 2026-08-11 07:28:02 on dist-test-slave-77v9"
server_key: "e058bd243d2873fc2a0c9112d60ed6f9"
server_key_iv: "4626337ded2a2d001dd05856eb78ca35"
server_key_version: "encryptionkey@0"
I20260811 07:28:02.405690 24056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "1dc46f0680534442ab73652f5cc60179"
format_stamp: "Formatted at 2026-08-11 07:28:02 on dist-test-slave-77v9"
server_key: "e058bd243d2873fc2a0c9112d60ed6f9"
server_key_iv: "4626337ded2a2d001dd05856eb78ca35"
server_key_version: "encryptionkey@0"
I20260811 07:28:02.409716 24056 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:28:02.412230 24072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:02.413489 24056 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:28:02.413618 24056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "1dc46f0680534442ab73652f5cc60179"
format_stamp: "Formatted at 2026-08-11 07:28:02 on dist-test-slave-77v9"
server_key: "e058bd243d2873fc2a0c9112d60ed6f9"
server_key_iv: "4626337ded2a2d001dd05856eb78ca35"
server_key_version: "encryptionkey@0"
I20260811 07:28:02.413735 24056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:02.438136 24056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:02.442284 24056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:02.442534 24056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:02.443230 24056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:02.444181 24056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:02.444260 24056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:02.444329 24056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:02.444360 24056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:02.455628 24056 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39673
I20260811 07:28:02.455649 24200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39673 every 8 connection(s)
I20260811 07:28:02.456696 24056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:28:02.465456 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 24056
I20260811 07:28:02.465643 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:28:02.465989 12256 external_mini_cluster.cc:1428] Setting key ca72970e170259d60026bb38fc24fcd3
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[23635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:02.473333 23730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.459074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:46945 (local address 127.11.248.62:37977)
0811 07:28:02.459237 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.459242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.460159 (+ 917us) server_negotiation.cc:407] Connection header received
0811 07:28:02.461872 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.461876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.461949 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.462090 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:02.463589 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.464279 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.465753 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.466145 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.466272 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.469576 (+ 3304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:02.469580 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:02.469582 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:02.469612 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:02.471115 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:02.471658 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:02.471661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:02.471663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:02.471790 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:02.472143 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:02.472146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:02.472147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:02.472364 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:02.472447 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.473087 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.473204 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:28:02.474211 24203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.459413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:37977 (local address 127.11.248.3:46945)
0811 07:28:02.459978 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.460031 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.461574 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.462309 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.462317 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.462764 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:02.463392 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.463408 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.464445 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.464447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.465558 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.465568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.466389 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.466395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.466658 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.467502 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:28:02.467523 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:02.469386 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:02.471233 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:02.471238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:02.471251 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:02.471532 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:02.471899 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:02.471902 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:02.471903 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:02.472046 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:02.472456 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:02.472461 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:02.472711 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.472980 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.473273 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":125,"threads_started":1}
I20260811 07:28:02.475732 24201 heartbeater.cc:347] Connected to a master server at 127.11.248.62:37977
I20260811 07:28:02.475991 24201 heartbeater.cc:464] Registering TS with master...
I20260811 07:28:02.476504 24201 heartbeater.cc:511] Master 127.11.248.62:37977 requested a full tablet report, sending...
I20260811 07:28:02.477654 23687 ts_manager.cc:194] Registered new tserver with Master: 1dc46f0680534442ab73652f5cc60179 (127.11.248.3:39673)
I20260811 07:28:02.478322 23687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:46945
I20260811 07:28:02.480772 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:28:02.490877 23730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.482922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49888 (local address 127.11.248.62:37977)
0811 07:28:02.483094 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.483100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.483280 (+ 180us) server_negotiation.cc:407] Connection header received
0811 07:28:02.483457 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.483460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.483516 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.483599 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:02.484360 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.484982 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.485950 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.486190 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.486297 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.487742 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:02.487745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:02.487748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:02.487776 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:02.489077 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:02.489514 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:02.489518 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:02.489520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:02.489607 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:02.489896 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:02.489901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:02.489903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:02.490149 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:02.490290 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.490574 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.490707 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:28:02.494113 23687 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:28:02.497584 23687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:28:02.513796 24218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.507762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39673 (local address 127.0.0.1:40960)
0811 07:28:02.508033 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.508048 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.508187 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.509322 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.509325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.509353 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:02.509454 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.509464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.510475 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.510482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.511922 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.511933 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.513116 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.513119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.513280 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.513344 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.513478 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.513645 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":3,"spinlock_wait_cycles":2688,"thread_start_us":94,"threads_started":1}
I20260811 07:28:02.513798 24219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.508427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40960 (local address 127.11.248.3:39673)
0811 07:28:02.508949 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.508962 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.508993 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:28:02.509054 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.509058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.509182 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.509340 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:02.509598 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.510341 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.512131 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.512984 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.513111 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.513270 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.513513 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.513620 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":135,"threads_started":1}
I20260811 07:28:02.513928 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.507133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32814 (local address 127.11.248.1:36063)
0811 07:28:02.507888 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.507894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.508070 (+ 176us) server_negotiation.cc:407] Connection header received
0811 07:28:02.508375 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.508395 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.508610 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.508738 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:02.509423 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.510651 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.512299 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.513139 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.513239 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.513373 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.513681 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.513768 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":126,"threads_started":1}
I20260811 07:28:02.514051 24217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.507442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33680 (local address 127.11.248.2:38055)
0811 07:28:02.507777 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.507791 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.508079 (+ 288us) server_negotiation.cc:407] Connection header received
0811 07:28:02.508378 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.508384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.508619 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.508749 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:02.509428 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.510657 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.512101 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.512983 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.513099 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.513270 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.513664 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.513769 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":131,"threads_started":1}
I20260811 07:28:02.514374 24214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.506930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36063 (local address 127.0.0.1:32814)
0811 07:28:02.507921 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.507979 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.508187 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.508991 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.508997 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.509031 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:02.509273 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.509282 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.511036 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.511040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.512158 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.512170 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.513431 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.513435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.513517 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.513552 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.514110 (+ 558us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.514203 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":45,"spinlock_wait_cycles":21120,"thread_start_us":142,"threads_started":1}
I20260811 07:28:02.514791 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.507241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:38055 (local address 127.0.0.1:33680)
0811 07:28:02.507932 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.507984 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.508187 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.508992 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.508997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.509033 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:02.509278 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.509283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.510813 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.510817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.511940 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.511946 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.513340 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.513344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.513471 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.513495 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.513567 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.514634 (+ 1067us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":1041,"spinlock_wait_cycles":13824,"thread_start_us":126,"threads_started":1}
I20260811 07:28:02.517438 23975 tablet_service.cc:1467] Processing CreateTablet for tablet 5f6ea1b4731c43f7a7176789db7b2f97 (DEFAULT_TABLE table=test-table [id=cdfa476dac47493a8d5ab4d6d7a2ffcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:28:02.517431 24124 tablet_service.cc:1467] Processing CreateTablet for tablet 5f6ea1b4731c43f7a7176789db7b2f97 (DEFAULT_TABLE table=test-table [id=cdfa476dac47493a8d5ab4d6d7a2ffcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:28:02.517429 23826 tablet_service.cc:1467] Processing CreateTablet for tablet 5f6ea1b4731c43f7a7176789db7b2f97 (DEFAULT_TABLE table=test-table [id=cdfa476dac47493a8d5ab4d6d7a2ffcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:28:02.518602 23826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f6ea1b4731c43f7a7176789db7b2f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:02.518607 24124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f6ea1b4731c43f7a7176789db7b2f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:02.518610 23975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f6ea1b4731c43f7a7176789db7b2f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:02.525456 24220 tablet_bootstrap.cc:492] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Bootstrap starting.
I20260811 07:28:02.526914 24223 tablet_bootstrap.cc:492] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: Bootstrap starting.
I20260811 07:28:02.527001 24222 tablet_bootstrap.cc:492] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Bootstrap starting.
I20260811 07:28:02.528514 24220 tablet_bootstrap.cc:654] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:02.528712 24223 tablet_bootstrap.cc:654] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:02.529198 24222 tablet_bootstrap.cc:654] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:02.529529 24223 log.cc:824] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:02.529557 24220 log.cc:824] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:02.530429 24222 log.cc:824] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:02.532116 24223 tablet_bootstrap.cc:492] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: No bootstrap required, opened a new log
I20260811 07:28:02.532203 24220 tablet_bootstrap.cc:492] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: No bootstrap required, opened a new log
I20260811 07:28:02.532353 24223 ts_tablet_manager.cc:1397] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260811 07:28:02.532398 24220 ts_tablet_manager.cc:1397] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:28:02.532449 24222 tablet_bootstrap.cc:492] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: No bootstrap required, opened a new log
I20260811 07:28:02.532660 24222 ts_tablet_manager.cc:1397] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:28:02.536134 24223 raft_consensus.cc:348] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.536434 24223 raft_consensus.cc:374] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:02.536512 24223 raft_consensus.cc:729] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 975b24d6f2e5437bb0456c42d5ca1335, State: Initialized, Role: FOLLOWER
I20260811 07:28:02.536441 24220 raft_consensus.cc:348] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.536441 24222 raft_consensus.cc:348] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.536695 24222 raft_consensus.cc:374] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:02.536729 24220 raft_consensus.cc:374] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:02.536778 24222 raft_consensus.cc:729] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc46f0680534442ab73652f5cc60179, State: Initialized, Role: FOLLOWER
I20260811 07:28:02.536834 24220 raft_consensus.cc:729] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beda7ac3bc84b8b801f4a45fa6a7b28, State: Initialized, Role: FOLLOWER
I20260811 07:28:02.537217 24223 consensus_queue.cc:260] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.537297 24220 consensus_queue.cc:260] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.537297 24222 consensus_queue.cc:260] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.538403 24222 ts_tablet_manager.cc:1428] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:28:02.538398 24220 ts_tablet_manager.cc:1428] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 07:28:02.538407 24223 ts_tablet_manager.cc:1428] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:28:02.538636 24201 heartbeater.cc:503] Master 127.11.248.62:37977 was elected leader, sending a full tablet report...
I20260811 07:28:02.538815 24049 heartbeater.cc:503] Master 127.11.248.62:37977 was elected leader, sending a full tablet report...
I20260811 07:28:02.539685 23901 heartbeater.cc:503] Master 127.11.248.62:37977 was elected leader, sending a full tablet report...
W20260811 07:28:02.707865 24202 tablet.cc:2369] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:28:02.714525 24050 tablet.cc:2369] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:28:02.715119 24227 raft_consensus.cc:482] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:28:02.715344 24227 raft_consensus.cc:504] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.716454 24227 leader_election.cc:288] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 975b24d6f2e5437bb0456c42d5ca1335 (127.11.248.1:36063), 1dc46f0680534442ab73652f5cc60179 (127.11.248.3:39673)
I20260811 07:28:02.721174 24053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.716892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36063 (local address 127.11.248.2:36837)
0811 07:28:02.717077 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.717096 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.717237 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.717591 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.717594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.717623 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:02.717740 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.717747 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.718733 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.718737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.719701 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.719710 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.720706 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.720710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.720874 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.720898 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.720980 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.721040 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":22}
I20260811 07:28:02.721271 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.717004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:36837 (local address 127.11.248.1:36063)
0811 07:28:02.717177 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.717182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.717202 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:28:02.717387 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.717390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.717451 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.717540 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:02.717904 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.718629 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.719841 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.720551 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.720682 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.720737 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.721022 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.721111 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:28:02.721455 24219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.717378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:55397 (local address 127.11.248.3:39673)
0811 07:28:02.717561 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.717565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.717613 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:28:02.717894 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.717900 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.717950 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.718017 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:02.718303 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.719044 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.720223 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.720693 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.720858 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.720909 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.721224 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.721306 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:28:02.721451 24230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.717230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39673 (local address 127.11.248.2:55397)
0811 07:28:02.717521 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.717536 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:02.717689 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:02.718051 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:02.718054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:02.718072 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:02.718192 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.718198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.719162 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.719164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.720098 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:02.720108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.720926 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.720930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:02.721076 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.721100 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:28:02.721190 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:28:02.721272 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":2,"spinlock_wait_cycles":1280,"thread_start_us":83,"threads_started":1}
I20260811 07:28:02.722128 24150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f6ea1b4731c43f7a7176789db7b2f97" candidate_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc46f0680534442ab73652f5cc60179" is_pre_election: true
I20260811 07:28:02.722213 23850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f6ea1b4731c43f7a7176789db7b2f97" candidate_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975b24d6f2e5437bb0456c42d5ca1335" is_pre_election: true
I20260811 07:28:02.722522 24150 raft_consensus.cc:2454] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6beda7ac3bc84b8b801f4a45fa6a7b28 in term 0.
I20260811 07:28:02.722556 23850 raft_consensus.cc:2454] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6beda7ac3bc84b8b801f4a45fa6a7b28 in term 0.
I20260811 07:28:02.723030 23927 leader_election.cc:302] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beda7ac3bc84b8b801f4a45fa6a7b28, 975b24d6f2e5437bb0456c42d5ca1335; no voters:
I20260811 07:28:02.723327 24227 raft_consensus.cc:2781] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:28:02.723412 24227 raft_consensus.cc:482] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:28:02.723443 24227 raft_consensus.cc:3037] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:02.724608 24227 raft_consensus.cc:504] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.725001 24227 leader_election.cc:288] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [CANDIDATE]: Term 1 election: Requested vote from peers 975b24d6f2e5437bb0456c42d5ca1335 (127.11.248.1:36063), 1dc46f0680534442ab73652f5cc60179 (127.11.248.3:39673)
I20260811 07:28:02.725400 23850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f6ea1b4731c43f7a7176789db7b2f97" candidate_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "975b24d6f2e5437bb0456c42d5ca1335"
I20260811 07:28:02.725471 24150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f6ea1b4731c43f7a7176789db7b2f97" candidate_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc46f0680534442ab73652f5cc60179"
I20260811 07:28:02.725565 23850 raft_consensus.cc:3037] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:02.725628 24150 raft_consensus.cc:3037] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:02.726683 23850 raft_consensus.cc:2454] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beda7ac3bc84b8b801f4a45fa6a7b28 in term 1.
I20260811 07:28:02.726724 24150 raft_consensus.cc:2454] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6beda7ac3bc84b8b801f4a45fa6a7b28 in term 1.
I20260811 07:28:02.726980 23927 leader_election.cc:302] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6beda7ac3bc84b8b801f4a45fa6a7b28, 975b24d6f2e5437bb0456c42d5ca1335; no voters:
I20260811 07:28:02.727185 24227 raft_consensus.cc:2781] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 07:28:02.727263 23902 tablet.cc:2369] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:28:02.727450 24227 raft_consensus.cc:686] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 1 LEADER]: Becoming Leader. State: Replica: 6beda7ac3bc84b8b801f4a45fa6a7b28, State: Running, Role: LEADER
I20260811 07:28:02.727821 24227 consensus_queue.cc:237] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } }
I20260811 07:28:02.731164 23687 catalog_manager.cc:5495] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beda7ac3bc84b8b801f4a45fa6a7b28 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6beda7ac3bc84b8b801f4a45fa6a7b28" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20260811 07:28:02.753257 24217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.749474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33694 (local address 127.11.248.2:38055)
0811 07:28:02.749613 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:02.749616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:02.749630 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:28:02.749709 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:02.749711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:02.749770 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:02.749882 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:28:02.750145 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.750646 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.751584 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:02.751832 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:02.751924 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:02.752278 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:28:02.752728 (+ 450us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:28:02.752964 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:02.753057 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 07:28:02.753115 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:28:02.759529 24150 raft_consensus.cc:1261] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 1 FOLLOWER]: Refusing update from remote peer 6beda7ac3bc84b8b801f4a45fa6a7b28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:28:02.759528 23850 raft_consensus.cc:1261] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 1 FOLLOWER]: Refusing update from remote peer 6beda7ac3bc84b8b801f4a45fa6a7b28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:28:02.760398 24227 consensus_queue.cc:1035] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "975b24d6f2e5437bb0456c42d5ca1335" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:28:02.760634 24231 consensus_queue.cc:1035] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc46f0680534442ab73652f5cc60179" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:28:02.771446 24236 mvcc.cc:205] Tried to move back new op lower bound from 7317230726174388224 to 7317230726056124416. Current Snapshot: MvccSnapshot[applied={T|T < 7317230726174388224}]
I20260811 07:28:02.778529 23687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:28:02.778710 23687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:28:02.781512 23687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a53fba8bc44a4c6ca4b60ad1df9c595f: Sending DeleteTablet for 3 replicas of tablet 5f6ea1b4731c43f7a7176789db7b2f97
I20260811 07:28:02.782503 23826 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f6ea1b4731c43f7a7176789db7b2f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:28:02 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:32814
I20260811 07:28:02.782501 23975 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f6ea1b4731c43f7a7176789db7b2f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:28:02 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:33680
I20260811 07:28:02.782644 24124 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f6ea1b4731c43f7a7176789db7b2f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:28:02 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:40960
I20260811 07:28:02.783115 24244 tablet_replica.cc:330] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335: stopping tablet replica
I20260811 07:28:02.783258 24245 tablet_replica.cc:330] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: stopping tablet replica
I20260811 07:28:02.783583 24244 raft_consensus.cc:2229] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:28:02.783723 24245 raft_consensus.cc:2229] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:28:02.783886 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23757
I20260811 07:28:02.784072 24244 raft_consensus.cc:2258] T 5f6ea1b4731c43f7a7176789db7b2f97 P 975b24d6f2e5437bb0456c42d5ca1335 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:28:02.785619 24245 raft_consensus.cc:2258] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:28:02.787672 24245 ts_tablet_manager.cc:1905] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:28:02.789304 24246 tablet_replica.cc:330] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: stopping tablet replica
I20260811 07:28:02.789717 24246 raft_consensus.cc:2229] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:28:02.790108 24246 raft_consensus.cc:2258] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:28:02.791244 24245 ts_tablet_manager.cc:1918] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:28:02.791455 24245 log.cc:1196] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/5f6ea1b4731c43f7a7176789db7b2f97
I20260811 07:28:02.791850 24245 ts_tablet_manager.cc:1939] T 5f6ea1b4731c43f7a7176789db7b2f97 P 6beda7ac3bc84b8b801f4a45fa6a7b28: Deleting consensus metadata
I20260811 07:28:02.793252 23671 catalog_manager.cc:4841] TS 6beda7ac3bc84b8b801f4a45fa6a7b28 (127.11.248.2:38055): tablet 5f6ea1b4731c43f7a7176789db7b2f97 (table test-table [id=cdfa476dac47493a8d5ab4d6d7a2ffcc]) successfully deleted
I20260811 07:28:02.794342 24246 ts_tablet_manager.cc:1905] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:28:02.796706 23672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:36063 (error 108)
I20260811 07:28:02.796906 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23906
I20260811 07:28:02.799679 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:02.799272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36063 (local address 127.0.0.1:32826)
0811 07:28:02.799496 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:02.799575 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:36063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260811 07:28:02.799695 24246 ts_tablet_manager.cc:1918] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:28:02.799841 24246 log.cc:1196] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/5f6ea1b4731c43f7a7176789db7b2f97
W20260811 07:28:02.800103 23672 catalog_manager.cc:4584] TS 975b24d6f2e5437bb0456c42d5ca1335 (127.11.248.1:36063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5f6ea1b4731c43f7a7176789db7b2f97: Network error: Client connection negotiation failed: client connection to 127.11.248.1:36063: connect: Connection refused (error 111)
I20260811 07:28:02.800388 24246 ts_tablet_manager.cc:1939] T 5f6ea1b4731c43f7a7176789db7b2f97 P 1dc46f0680534442ab73652f5cc60179: Deleting consensus metadata
I20260811 07:28:02.802181 23672 catalog_manager.cc:4841] TS 1dc46f0680534442ab73652f5cc60179 (127.11.248.3:39673): tablet 5f6ea1b4731c43f7a7176789db7b2f97 (table test-table [id=cdfa476dac47493a8d5ab4d6d7a2ffcc]) successfully deleted
I20260811 07:28:02.806289 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 24056
I20260811 07:28:02.814682 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 23651
2026-08-11T07:28:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2667 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[24250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[24250](info): set up 2 sockets
Aug 11 07:28:02 dist-test-slave-77v9 krb5kdc[24250](info): commencing operation
krb5kdc: starting...
W20260811 07:28:03.940199 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:28:04 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:28:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:28:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/rangeradmin_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/rangeradmin_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/rangerlookup_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/rangerlookup_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
I20260811 07:28:04.137073 12256 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMRD5fR/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/postgres -l logfile start
2026-08-11 07:28:07.048 UTC [24284] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:28:07.048 UTC [24284] LOG: listening on IPv4 address "127.11.248.20", port 34031
2026-08-11 07:28:07.053 UTC [24284] LOG: listening on Unix socket "/tmp/.s.PGSQL.34031"
2026-08-11 07:28:07.090 UTC [24287] LOG: database system was shut down at 2026-08-11 07:28:05 UTC
2026-08-11 07:28:07.094 UTC [24284] LOG: database system is ready to accept connections
I20260811 07:28:08.125450 12256 mini_postgres.cc:96] Postgres bound to 34031
2026-08-11 07:28:08.133 UTC [24296] FATAL: database "slave" does not exist
127.11.248.20:34031 - accepting connections
I20260811 07:28:08.134025 12256 mini_ranger.cc:161] Starting Ranger...
I20260811 07:28:08.152367 12256 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:28:08.734680 12256 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:28:08.734779 12256 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-admin
2026-08-11 07:28:09,045 [I] DB FLAVOR :POSTGRES
2026-08-11 07:28:09,046 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:28:09,046 [I] Checking connection..
2026-08-11 07:28:09,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:28:09,300 [I] Checking connection passed.
2026-08-11 07:28:09,301 [I] --------- Verifying version history table ---------
2026-08-11 07:28:09,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:28:09,570 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:28:09,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:28:09,827 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:28:09,827 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:28:09,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:28:10.078 UTC [24367] WARNING: there is no transaction in progress
2026-08-11 07:28:10,086 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:28:10,087 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:28:10,348 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:28:10,349 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:28:10,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:28:10,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:28:10,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-77v9.c.gcp-upstream.internal','N') ;"
2026-08-11 07:28:11,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:28:11,462 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:28:11,463 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:28:11,710 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:28:11,710 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:28:11,952 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:28:12,204 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:28:12,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:28:13.307 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.327 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.345 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.364 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.383 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.405 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.481 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.490 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.507 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.519 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.532 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.548 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.558 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.567 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.576 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:13.584 UTC [24483] WARNING: there is no transaction in progress
2026-08-11 07:28:14,363 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:28:14,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:28:14,600 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:28:14,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:28:14,879 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:28:14,880 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:28:15,128 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:28:15,128 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:28:15,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:28:15,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-77v9.c.gcp-upstream.internal';"
2026-08-11 07:28:15,884 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:28:15,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:28:16,132 [I] DB_PATCHES have already been applied
I20260811 07:28:16.138854 12256 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMRD5fR/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:28:16.138931 12256 mini_ranger.cc:193] Using host: 127.11.248.20
I20260811 07:28:16.143636 12256 mini_ranger.cc:227] Ranger admin URL: http://127.11.248.20:41457
Aug 11, 2026 7:28:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:28:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:28:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:28:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:28:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:28:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:28:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:28:17.410925 12256 mini_ranger.cc:160] Time spent starting Ranger: real 9.277s user 0.001s sys 0.014s
Aug 11, 2026 7:28:40 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:28:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:28:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:28:40 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:28:41 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:28:42.535804 12256 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/rangerkms_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/rangerkms_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.248.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.248.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:28:42 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433322, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:28:42.641547 12256 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:28:42.656383 12256 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:28:43.704931 12256 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:28:43.705045 12256 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms
I20260811 07:28:43.705159 12256 mini_ranger_kms.cc:227] Using postgres at 127.11.248.20:34031
2026-08-11 07:28:44,423 [I] DB FLAVOR :POSTGRES
2026-08-11 07:28:44,423 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:28:44,423 [I] Checking connection
2026-08-11 07:28:44,423 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:28:44,768 [I] connection success
2026-08-11 07:28:44,768 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:28:44,768 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:28:44,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:28:45,081 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:28:45,081 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:28:45,082 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:28:45,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:34031/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:28:45,411 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:28:45.967692 12256 mini_ranger_kms.cc:310] Created kms service
I20260811 07:28:46.226997 12256 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:28:46.273392 12256 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:28:46 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433322, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:28:46.722455 12256 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:28:46.722823 12256 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:28:46.722863 12256 mini_ranger_kms.cc:240] Using host: 127.11.248.20
I20260811 07:28:46.727944 12256 mini_ranger_kms.cc:276] Ranger KMS PID: 24691
I20260811 07:28:46.728107 12256 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.248.20:44165
Aug 11, 2026 7:28:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:28:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:28:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:28:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:28:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:28:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 07:28:49.230145 12256 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.589s user 0.008s sys 0.682s
I20260811 07:28:49.230296 12256 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:28:49.230422 12256 mini_ranger_kms.cc:401] 127.11.248.20:44165/kms/v1/keys
Aug 11 07:28:49 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433329, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.248.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 07:28:49 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433329, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.248.20@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
Aug 11 07:28:50 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433329, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.248.20@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
Aug 11 07:28:52 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:28:53.037405 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36663
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36663
--ranger_config_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:44165/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:53.201718 24747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:53.202041 24747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:53.202083 24747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:53.206594 24747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:28:53.206672 24747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:53.206691 24747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:53.206708 24747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:28:53.206723 24747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:28:53.212785 24747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.248.20:44165/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36663
--ranger_config_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:53.214015 24747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:53.215092 24747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:53.226266 24755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:53.226500 24747 server_base.cc:1034] running on GCE node
W20260811 07:28:53.226365 24752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:53.226389 24753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:53.227283 24747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:53.228399 24747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:53.229594 24747 hybrid_clock.cc:648] HybridClock initialized: now 1786433333229575 us; error 34 us; skew 500 ppm
Aug 11 07:28:53 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:53.233083 24747 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:28:53.234148 24747 webserver.cc:460] Webserver started at http://127.11.248.62:45971/ using document root <none> and password file <none>
I20260811 07:28:53.234721 24747 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:53.234813 24747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:53.235040 24747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:28:53 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:28:53.293676 24747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "c3b0a276829245c08ac0a99eef7036b4"
format_stamp: "Formatted at 2026-08-11 07:28:53 on dist-test-slave-77v9"
server_key: "783ff68621434100d53beb271653d28e"
server_key_iv: "5c852c2b060f7cc2288b955cea1e587a"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:53.294473 24747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "c3b0a276829245c08ac0a99eef7036b4"
format_stamp: "Formatted at 2026-08-11 07:28:53 on dist-test-slave-77v9"
server_key: "783ff68621434100d53beb271653d28e"
server_key_iv: "5c852c2b060f7cc2288b955cea1e587a"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:53.300060 24747 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260811 07:28:53.319314 24763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:53.321087 24747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:28:53.321256 24747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "c3b0a276829245c08ac0a99eef7036b4"
format_stamp: "Formatted at 2026-08-11 07:28:53 on dist-test-slave-77v9"
server_key: "783ff68621434100d53beb271653d28e"
server_key_iv: "5c852c2b060f7cc2288b955cea1e587a"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:53.321419 24747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:53.335207 24747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:53.338572 24747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:53.338847 24747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:53.354013 24747 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:36663
I20260811 07:28:53.354151 24819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:36663 every 8 connection(s)
I20260811 07:28:53.355168 24747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:28:53.358240 24820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:53.358979 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 24747
I20260811 07:28:53.359124 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:28:53.359445 12256 external_mini_cluster.cc:1428] Setting key 5215dcac0b696b2aff11c10d3c79f8a4
I20260811 07:28:53.364779 24820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4: Bootstrap starting.
I20260811 07:28:53.367559 24820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:53.368574 24820 log.cc:824] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:28:53 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:53.370937 24820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4: No bootstrap required, opened a new log
I20260811 07:28:53.375017 24820 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b0a276829245c08ac0a99eef7036b4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36663 } }
I20260811 07:28:53.375286 24820 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:53.375372 24820 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b0a276829245c08ac0a99eef7036b4, State: Initialized, Role: FOLLOWER
I20260811 07:28:53.375891 24820 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b0a276829245c08ac0a99eef7036b4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36663 } }
I20260811 07:28:53.376046 24820 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:28:53.376147 24820 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:28:53.376248 24820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:53.376700 24823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:53.361012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60358 (local address 127.11.248.62:36663)
0811 07:28:53.361577 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:53.361609 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:53.361648 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:28:53.362592 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:53.362610 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:53.362943 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:53.363221 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:53.364258 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:53.365508 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:53.366745 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:53.367263 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:53.367390 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:53.370744 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:53.370750 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:53.370763 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:53.370792 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:53.373509 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:53.374021 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:53.374026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:53.374031 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:53.374137 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:53.374441 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:53.374445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:53.374447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:53.374852 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:53.375127 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:53.375374 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 07:28:53.375685 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":201,"threads_started":1}
I20260811 07:28:53.377552 24820 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b0a276829245c08ac0a99eef7036b4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36663 } }
I20260811 07:28:53.377911 24820 leader_election.cc:302] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3b0a276829245c08ac0a99eef7036b4; no voters:
I20260811 07:28:53.378268 24820 leader_election.cc:288] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:28:53.378353 24825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:28:53.378638 24825 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [term 1 LEADER]: Becoming Leader. State: Replica: c3b0a276829245c08ac0a99eef7036b4, State: Running, Role: LEADER
I20260811 07:28:53.378999 24825 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b0a276829245c08ac0a99eef7036b4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36663 } }
I20260811 07:28:53.379580 24820 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:28:53.380388 24827 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3b0a276829245c08ac0a99eef7036b4. Latest consensus state: current_term: 1 leader_uuid: "c3b0a276829245c08ac0a99eef7036b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b0a276829245c08ac0a99eef7036b4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36663 } } }
I20260811 07:28:53.380576 24827 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [sys.catalog]: This master's current role is: LEADER
I20260811 07:28:53.381134 24826 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3b0a276829245c08ac0a99eef7036b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b0a276829245c08ac0a99eef7036b4" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36663 } } }
I20260811 07:28:53.381248 24826 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4 [sys.catalog]: This master's current role is: LEADER
I20260811 07:28:53.382076 24834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:28:53.385437 24834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:28:53.386080 24820 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:28:53.397506 24834 catalog_manager.cc:1347] Generated new cluster ID: b5c299b27115424eab3d637659e6dd69
I20260811 07:28:53.397622 24834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:28:53.423292 24834 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:28:53.424729 24834 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:28:53.435781 24834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4: Generated new TSK 0
I20260811 07:28:53.437273 24834 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:28:54.393121 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:44165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36663
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:54.581534 24872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:54.582010 24872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:54.582093 24872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:54.588725 24872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:54.588840 24872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:54.588946 24872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:28:54.598531 24872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.248.20:44165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:54.600317 24872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:54.601799 24872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:54.617007 24880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:54.617092 24881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:54.617043 24883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:54.617620 24872 server_base.cc:1034] running on GCE node
I20260811 07:28:54.618311 24872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:54.619340 24872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:54.620574 24872 hybrid_clock.cc:648] HybridClock initialized: now 1786433334620564 us; error 49 us; skew 500 ppm
Aug 11 07:28:54 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:54.625298 24872 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:28:54.626406 24872 webserver.cc:460] Webserver started at http://127.11.248.1:35397/ using document root <none> and password file <none>
I20260811 07:28:54.627131 24872 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:54.627229 24872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:54.627518 24872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:28:54 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:28:54.648756 24872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "010f83a329a24342b03a5d831e198761"
format_stamp: "Formatted at 2026-08-11 07:28:54 on dist-test-slave-77v9"
server_key: "f408f3f332aa892a82592a151cdfb65f"
server_key_iv: "3629c40d38a64ae2f0d820a0261b7e16"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:54.650673 24872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "010f83a329a24342b03a5d831e198761"
format_stamp: "Formatted at 2026-08-11 07:28:54 on dist-test-slave-77v9"
server_key: "f408f3f332aa892a82592a151cdfb65f"
server_key_iv: "3629c40d38a64ae2f0d820a0261b7e16"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:54.656754 24872 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260811 07:28:54.685740 24890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:54.687767 24872 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260811 07:28:54.687927 24872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "010f83a329a24342b03a5d831e198761"
format_stamp: "Formatted at 2026-08-11 07:28:54 on dist-test-slave-77v9"
server_key: "f408f3f332aa892a82592a151cdfb65f"
server_key_iv: "3629c40d38a64ae2f0d820a0261b7e16"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:54.688088 24872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:54.715157 24872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:54.719611 24872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:54.719900 24872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:54.720989 24872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:54.722481 24872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:54.722616 24872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260811 07:28:54.722756 24872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:54.722880 24872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:54.746490 24872 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:44001
I20260811 07:28:54.746657 25019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:44001 every 8 connection(s)
I20260811 07:28:54.748078 24872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:28:54.749138 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 24872
I20260811 07:28:54.749279 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:28:54.749615 12256 external_mini_cluster.cc:1428] Setting key de22d9d91880a300a873003f36f59c75
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Aug 11 07:28:54 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:54.786744 25023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:54.761835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:39937 (local address 127.11.248.62:36663)
0811 07:28:54.763770 (+ 1935us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:54.763777 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:54.764499 (+ 722us) server_negotiation.cc:407] Connection header received
0811 07:28:54.766767 (+ 2268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:54.766771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:54.766857 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:54.767023 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:54.769903 (+ 2880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:54.771132 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:54.773510 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:54.773900 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:54.774006 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:54.778652 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:54.778660 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:54.778664 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:54.778719 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:54.781656 (+ 2937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:54.782674 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:54.782678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:54.782680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:54.782802 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:54.783332 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:54.783335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:54.783337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:54.783779 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:54.786231 (+ 2452us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:54.786388 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 07:28:54.786573 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1803,"thread_start_us":92,"threads_started":1}
I20260811 07:28:54.786875 25024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:54.762402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36663 (local address 127.11.248.1:39937)
0811 07:28:54.764208 (+ 1806us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:54.764318 (+ 110us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:54.766230 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:54.767508 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:54.767521 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:54.768434 (+ 913us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:54.769608 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:54.769640 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:54.771362 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:54.771367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:54.773308 (+ 1941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:54.773323 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:54.774221 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:54.774226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:54.774579 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:54.775585 (+ 1006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:28:54.775616 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:54.778300 (+ 2684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:54.781960 (+ 3660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:54.781970 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:54.782003 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:54.782489 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:54.782931 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:54.782935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:54.782938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:54.783161 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:54.784034 (+ 873us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:54.784042 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:54.784905 (+ 863us) client_negotiation.cc:769] Sending connection context
0811 07:28:54.785191 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 07:28:54.785612 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1491,"thread_start_us":277,"threads_started":1}
I20260811 07:28:54.788616 25020 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36663
I20260811 07:28:54.788954 25020 heartbeater.cc:464] Registering TS with master...
I20260811 07:28:54.789625 25020 heartbeater.cc:511] Master 127.11.248.62:36663 requested a full tablet report, sending...
I20260811 07:28:54.791790 24780 ts_manager.cc:194] Registered new tserver with Master: 010f83a329a24342b03a5d831e198761 (127.11.248.1:44001)
I20260811 07:28:54.793567 24780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:39937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:28:54.808434 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:44165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36663
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:28:54 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:28:54.995164 25026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:54.995601 25026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:54.995683 25026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:55.002036 25026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:55.002128 25026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:55.002200 25026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:28:55.009123 25026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.248.20:44165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:55.010509 25026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:55.011739 25026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:55.024899 25032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:55.025056 25033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:55.025000 25035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:55.026216 25026 server_base.cc:1034] running on GCE node
I20260811 07:28:55.026966 25026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:55.027818 25026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:55.029147 25026 hybrid_clock.cc:648] HybridClock initialized: now 1786433335029047 us; error 100 us; skew 500 ppm
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:55.034444 25026 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:28:55.035753 25026 webserver.cc:460] Webserver started at http://127.11.248.2:46645/ using document root <none> and password file <none>
I20260811 07:28:55.036412 25026 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:55.036592 25026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:55.036931 25026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:28:55.052484 25026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "940af9bf647c484a98faf4092b80d676"
format_stamp: "Formatted at 2026-08-11 07:28:55 on dist-test-slave-77v9"
server_key: "51f2a58e76fb20f0e6b3d6f7712af25e"
server_key_iv: "0aa9d55b16fbc298a041d63695199c17"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:55.053668 25026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "940af9bf647c484a98faf4092b80d676"
format_stamp: "Formatted at 2026-08-11 07:28:55 on dist-test-slave-77v9"
server_key: "51f2a58e76fb20f0e6b3d6f7712af25e"
server_key_iv: "0aa9d55b16fbc298a041d63695199c17"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:55.061792 25026 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s
I20260811 07:28:55.079722 25043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:55.081550 25026 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:28:55.081717 25026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "940af9bf647c484a98faf4092b80d676"
format_stamp: "Formatted at 2026-08-11 07:28:55 on dist-test-slave-77v9"
server_key: "51f2a58e76fb20f0e6b3d6f7712af25e"
server_key_iv: "0aa9d55b16fbc298a041d63695199c17"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:55.081869 25026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:28:55.097368 25026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:55.102178 25026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:55.102530 25026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:55.103552 25026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:55.105244 25026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:55.105407 25026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:55.105540 25026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:55.105615 25026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:55.132961 25026 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:36983
I20260811 07:28:55.134749 25026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:28:55.138078 25167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:36983 every 8 connection(s)
I20260811 07:28:55.140504 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 25026
I20260811 07:28:55.140655 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:28:55.141180 12256 external_mini_cluster.cc:1428] Setting key 7bd88fa45cd10adacc99fcdd5b00d874
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:55.182051 25023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.142799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:40987 (local address 127.11.248.62:36663)
0811 07:28:55.142938 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:55.142948 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:55.153673 (+ 10725us) server_negotiation.cc:407] Connection header received
0811 07:28:55.157893 (+ 4220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:55.157898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:55.157968 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:55.158050 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:55.168330 (+ 10280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.169350 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.171689 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.172087 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.172192 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.176684 (+ 4492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:55.176690 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:55.176693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:55.176731 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:55.178853 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:55.179631 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:55.179636 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:55.179638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:55.179738 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:55.180221 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:55.180226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:55.180228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:55.180496 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:55.180587 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:55.181643 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0811 07:28:55.181815 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:28:55.184356 25170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.141243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36663 (local address 127.11.248.2:40987)
0811 07:28:55.153417 (+ 12174us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:55.153513 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:55.157468 (+ 3955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:55.158566 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:55.158578 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:55.158998 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:55.159847 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.159870 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.169633 (+ 9763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.169638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.171474 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.171493 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.172568 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.172575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.172939 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.173901 (+ 962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:28:55.173927 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:55.176358 (+ 2431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:55.179025 (+ 2667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:55.179033 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:55.179055 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:55.179487 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:55.179866 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:55.179869 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:55.179871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:55.180090 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:55.180662 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:55.180670 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:55.181276 (+ 606us) client_negotiation.cc:769] Sending connection context
0811 07:28:55.182653 (+ 1377us) client_negotiation.cc:240] Negotiation successful
0811 07:28:55.183085 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11810,"thread_start_us":278,"threads_started":1}
I20260811 07:28:55.186882 25168 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36663
I20260811 07:28:55.187166 25168 heartbeater.cc:464] Registering TS with master...
I20260811 07:28:55.187884 25168 heartbeater.cc:511] Master 127.11.248.62:36663 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:28:55.192349 24780 ts_manager.cc:194] Registered new tserver with Master: 940af9bf647c484a98faf4092b80d676 (127.11.248.2:36983)
I20260811 07:28:55.193257 24780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:40987
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:28:55.217372 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:44165/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36663
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:28:55.498342 25173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:28:55.498806 25173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:28:55.498911 25173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:28:55.505463 25173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:28:55.505635 25173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:28:55.505772 25173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:28:55.514600 25173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.248.20:44165/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:28:55.516501 25173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:28:55.518146 25173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:28:55.535205 25179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:55.535853 25178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:28:55.536749 25181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:28:55.538172 25173 server_base.cc:1034] running on GCE node
I20260811 07:28:55.539063 25173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:28:55.539929 25173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:28:55.541301 25173 hybrid_clock.cc:648] HybridClock initialized: now 1786433335541233 us; error 86 us; skew 500 ppm
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:28:55.546748 25173 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:28:55.548385 25173 webserver.cc:460] Webserver started at http://127.11.248.3:35677/ using document root <none> and password file <none>
I20260811 07:28:55.549386 25173 fs_manager.cc:359] Metadata directory not provided
I20260811 07:28:55.549566 25173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:28:55.549908 25173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:28:55.570115 25173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "7fb8932c66ba45cfba999d031084c18a"
format_stamp: "Formatted at 2026-08-11 07:28:55 on dist-test-slave-77v9"
server_key: "37dbc03a78381609b8190fdabf47b445"
server_key_iv: "064d8c2d5efe73b62d795c06cbfe70d8"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:55.571054 25173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "7fb8932c66ba45cfba999d031084c18a"
format_stamp: "Formatted at 2026-08-11 07:28:55 on dist-test-slave-77v9"
server_key: "37dbc03a78381609b8190fdabf47b445"
server_key_iv: "064d8c2d5efe73b62d795c06cbfe70d8"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:55.577782 25173 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260811 07:28:55.608129 25189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:55.613236 25173 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.000s
I20260811 07:28:55.613639 25173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "7fb8932c66ba45cfba999d031084c18a"
format_stamp: "Formatted at 2026-08-11 07:28:55 on dist-test-slave-77v9"
server_key: "37dbc03a78381609b8190fdabf47b445"
server_key_iv: "064d8c2d5efe73b62d795c06cbfe70d8"
server_key_version: "kuduclusterkey@0"
I20260811 07:28:55.614108 25173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:28:55.651747 25173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:28:55.661571 25173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:28:55.662504 25173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:28:55.663491 25173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:28:55.666226 25173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:28:55.666301 25173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:28:55.666352 25173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:28:55.666749 25173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 07:28:55.688656 25173 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39569
I20260811 07:28:55.690315 25173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:28:55.691275 25318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39569 every 8 connection(s)
I20260811 07:28:55.695060 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 25173
I20260811 07:28:55.695333 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:28:55.696058 12256 external_mini_cluster.cc:1428] Setting key 1df1ea1052123c23923325f0956d9e6f
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:28:55.713091 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.692561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:55223 (local address 127.11.248.62:36663)
0811 07:28:55.692843 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:55.692849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:55.694146 (+ 1297us) server_negotiation.cc:407] Connection header received
0811 07:28:55.698099 (+ 3953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:55.698103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:55.698161 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:55.698225 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:55.700277 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.701168 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.703034 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.703406 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.703492 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.707040 (+ 3548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:55.707044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:55.707047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:55.707081 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:55.709129 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:55.711172 (+ 2043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:55.711175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:55.711177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:55.711273 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:55.711689 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:55.711692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:55.711694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:55.711944 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:55.712022 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:55.712732 (+ 710us) server_negotiation.cc:299] Negotiation successful
0811 07:28:55.712900 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":68,"threads_started":1}
I20260811 07:28:55.715023 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.693245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36663 (local address 127.11.248.3:55223)
0811 07:28:55.693960 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:55.694022 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:55.697836 (+ 3814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:55.698657 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:55.698666 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:55.699278 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:28:55.700093 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.700113 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.701345 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.701349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.702830 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.702842 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.703734 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.703738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.703983 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.704784 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:28:55.704835 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:28:55.706790 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:28:55.709926 (+ 3136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:55.709943 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:55.709962 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:55.711050 (+ 1088us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:55.711383 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:28:55.711385 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:28:55.711387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:28:55.711578 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:28:55.712109 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:28:55.712116 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:28:55.712448 (+ 332us) client_negotiation.cc:769] Sending connection context
0811 07:28:55.713582 (+ 1134us) client_negotiation.cc:240] Negotiation successful
0811 07:28:55.713961 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":177,"threads_started":1}
I20260811 07:28:55.716516 25319 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36663
I20260811 07:28:55.716749 25319 heartbeater.cc:464] Registering TS with master...
I20260811 07:28:55.717335 25319 heartbeater.cc:511] Master 127.11.248.62:36663 requested a full tablet report, sending...
I20260811 07:28:55.718477 24780 ts_manager.cc:194] Registered new tserver with Master: 7fb8932c66ba45cfba999d031084c18a (127.11.248.3:39569)
I20260811 07:28:55.719228 24780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:55223
I20260811 07:28:55.722591 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:28:55.735481 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.725290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60366 (local address 127.11.248.62:36663)
0811 07:28:55.725414 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:55.725419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:55.726094 (+ 675us) server_negotiation.cc:407] Connection header received
0811 07:28:55.726285 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:55.726289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:55.726343 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:55.726414 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:28:55.727514 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.728313 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.729657 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.730030 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.730113 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.732006 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:28:55.732010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:28:55.732012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:28:55.732040 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:28:55.733653 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:55.734165 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:55.734170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:55.734172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:55.734263 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:28:55.734558 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:28:55.734561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:28:55.734563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:28:55.734755 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:28:55.734899 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:55.735143 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 07:28:55.735278 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:28:55.739234 24780 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60366:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:28:55.743752 24780 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:28:55.763336 25336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.755569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36983 (local address 127.0.0.1:42168)
0811 07:28:55.757371 (+ 1802us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:55.757386 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:55.757481 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:55.757990 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:55.757996 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:55.758019 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:55.758165 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.758172 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.759589 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.759595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.761162 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.761173 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.762618 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.762623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.762786 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.762871 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 07:28:55.762990 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:28:55.763147 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1746,"mutex_wait_us":7,"thread_start_us":132,"threads_started":1}
I20260811 07:28:55.763435 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.755527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36780 (local address 127.11.248.1:44001)
0811 07:28:55.757713 (+ 2186us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:55.757720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:55.757742 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:28:55.757810 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:55.757814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:55.757984 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:55.758114 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:55.758708 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.759822 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.761349 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.762289 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.762388 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.762545 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:55.763125 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 07:28:55.763232 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2089,"thread_start_us":119,"threads_started":1}
I20260811 07:28:55.764959 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.756006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42168 (local address 127.11.248.2:36983)
0811 07:28:55.756390 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:55.756397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:55.757506 (+ 1109us) server_negotiation.cc:407] Connection header received
0811 07:28:55.757623 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:55.757629 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:55.757816 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:55.757999 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:55.758311 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.759468 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.761340 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.762289 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.762401 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.762545 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:55.764683 (+ 2138us) server_negotiation.cc:299] Negotiation successful
0811 07:28:55.764790 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":107,"threads_started":1}
I20260811 07:28:55.765292 25337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.755411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44001 (local address 127.0.0.1:36780)
0811 07:28:55.756885 (+ 1474us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:55.756941 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:55.757084 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:55.758427 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:55.758441 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:55.758459 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:55.758576 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.758583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.759948 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.759952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.761199 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.761210 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.762639 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.762643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.762867 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.762886 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:28:55.762990 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:28:55.763453 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"mutex_wait_us":384,"thread_start_us":193,"threads_started":1}
I20260811 07:28:55.767727 25339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.756754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39569 (local address 127.0.0.1:39120)
0811 07:28:55.760043 (+ 3289us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:55.760057 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:55.760146 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:55.760765 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:55.760768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:55.760784 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:55.760911 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.760916 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.763069 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.763072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.764430 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:55.764441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.767321 (+ 2880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.767325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:55.767429 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.767455 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:28:55.767527 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 07:28:55.767604 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3230,"thread_start_us":192,"threads_started":1}
I20260811 07:28:55.768512 25340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:55.757015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39120 (local address 127.11.248.3:39569)
0811 07:28:55.757517 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:55.757558 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:55.760251 (+ 2693us) server_negotiation.cc:407] Connection header received
0811 07:28:55.760330 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:55.760336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:55.760503 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:55.760638 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:55.761042 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.762932 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.766112 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:55.766969 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:55.767083 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:55.767248 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:55.768261 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0811 07:28:55.768368 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":223,"threads_started":1}
I20260811 07:28:55.769392 24943 tablet_service.cc:1467] Processing CreateTablet for tablet 0831e2dde11b441bb3f9f69d8e8294cd (DEFAULT_TABLE table=test-table [id=f4b858a0916348dc97b43cc60ded3b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:28:55.769810 25091 tablet_service.cc:1467] Processing CreateTablet for tablet 0831e2dde11b441bb3f9f69d8e8294cd (DEFAULT_TABLE table=test-table [id=f4b858a0916348dc97b43cc60ded3b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:28:55.770843 25091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0831e2dde11b441bb3f9f69d8e8294cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:55.770843 24943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0831e2dde11b441bb3f9f69d8e8294cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:55.771803 25243 tablet_service.cc:1467] Processing CreateTablet for tablet 0831e2dde11b441bb3f9f69d8e8294cd (DEFAULT_TABLE table=test-table [id=f4b858a0916348dc97b43cc60ded3b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:28:55.772763 25243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0831e2dde11b441bb3f9f69d8e8294cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:28:55.783557 25341 tablet_bootstrap.cc:492] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: Bootstrap starting.
I20260811 07:28:55.785151 25342 tablet_bootstrap.cc:492] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Bootstrap starting.
I20260811 07:28:55.787952 25342 tablet_bootstrap.cc:654] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:55.788357 25341 tablet_bootstrap.cc:654] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:55.789822 25342 log.cc:824] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:55.790002 25343 tablet_bootstrap.cc:492] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Bootstrap starting.
I20260811 07:28:55.790822 25341 log.cc:824] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:55.793119 25342 tablet_bootstrap.cc:492] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: No bootstrap required, opened a new log
I20260811 07:28:55.793367 25342 ts_tablet_manager.cc:1397] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260811 07:28:55.794036 25343 tablet_bootstrap.cc:654] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Neither blocks nor log segments found. Creating new log.
I20260811 07:28:55.795619 25341 tablet_bootstrap.cc:492] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: No bootstrap required, opened a new log
I20260811 07:28:55.795966 25341 ts_tablet_manager.cc:1397] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260811 07:28:55.795879 25343 log.cc:824] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:28:55.797686 25020 heartbeater.cc:503] Master 127.11.248.62:36663 was elected leader, sending a full tablet report...
I20260811 07:28:55.801379 25342 raft_consensus.cc:348] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:55.801887 25342 raft_consensus.cc:374] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:55.802008 25342 raft_consensus.cc:729] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 940af9bf647c484a98faf4092b80d676, State: Initialized, Role: FOLLOWER
I20260811 07:28:55.802747 25342 consensus_queue.cc:260] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:55.804533 25342 ts_tablet_manager.cc:1428] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260811 07:28:55.804431 25341 raft_consensus.cc:348] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:55.804749 25341 raft_consensus.cc:374] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:55.804838 25341 raft_consensus.cc:729] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010f83a329a24342b03a5d831e198761, State: Initialized, Role: FOLLOWER
I20260811 07:28:55.805099 25168 heartbeater.cc:503] Master 127.11.248.62:36663 was elected leader, sending a full tablet report...
I20260811 07:28:55.805999 25341 consensus_queue.cc:260] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:55.807528 25341 ts_tablet_manager.cc:1428] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260811 07:28:55.811074 25343 tablet_bootstrap.cc:492] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: No bootstrap required, opened a new log
I20260811 07:28:55.811383 25343 ts_tablet_manager.cc:1397] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.000s
I20260811 07:28:55.817988 25343 raft_consensus.cc:348] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:55.818435 25343 raft_consensus.cc:374] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:28:55.818588 25343 raft_consensus.cc:729] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fb8932c66ba45cfba999d031084c18a, State: Initialized, Role: FOLLOWER
I20260811 07:28:55.819212 25343 consensus_queue.cc:260] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:55.820231 25319 heartbeater.cc:503] Master 127.11.248.62:36663 was elected leader, sending a full tablet report...
I20260811 07:28:55.820621 25343 ts_tablet_manager.cc:1428] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
W20260811 07:28:55.905052 25169 tablet.cc:2369] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:28:55.942566 25320 tablet.cc:2369] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:28:55 dist-test-slave-77v9 krb5kdc[24250](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
W20260811 07:28:56.010610 25021 tablet.cc:2369] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:28:56.166996 25348 raft_consensus.cc:482] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:28:56.167309 25348 raft_consensus.cc:504] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:56.168838 25348 leader_election.cc:288] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010f83a329a24342b03a5d831e198761 (127.11.248.1:44001), 7fb8932c66ba45cfba999d031084c18a (127.11.248.3:39569)
I20260811 07:28:56.186160 25340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:56.170913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:40597 (local address 127.11.248.3:39569)
0811 07:28:56.171045 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:56.171050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:56.181028 (+ 9978us) server_negotiation.cc:407] Connection header received
0811 07:28:56.181293 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:56.181297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:56.181353 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:56.181405 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:56.181963 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.182702 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.184584 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.185287 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.185394 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:56.185453 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:56.185924 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 07:28:56.186013 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:28:56.186422 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:56.170728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:59499 (local address 127.11.248.1:44001)
0811 07:28:56.170894 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:56.170900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:56.175297 (+ 4397us) server_negotiation.cc:407] Connection header received
0811 07:28:56.175486 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:56.175491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:56.175553 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:56.175657 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:28:56.176085 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.177007 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.184951 (+ 7944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.185631 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.185746 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:56.185801 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:56.186182 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 07:28:56.186285 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:28:56.187115 25355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:56.169343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44001 (local address 127.11.248.2:59499)
0811 07:28:56.175167 (+ 5824us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:56.175189 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:56.175344 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:56.175796 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:56.175800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:56.175820 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:56.175933 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:56.175940 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.177188 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.177192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:56.178749 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:56.178762 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.185917 (+ 7155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.185921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:56.186023 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:56.186045 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:28:56.186701 (+ 656us) client_negotiation.cc:240] Negotiation successful
0811 07:28:56.186794 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5691,"thread_start_us":291,"threads_started":1}
I20260811 07:28:56.188086 24968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831e2dde11b441bb3f9f69d8e8294cd" candidate_uuid: "940af9bf647c484a98faf4092b80d676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010f83a329a24342b03a5d831e198761" is_pre_election: true
I20260811 07:28:56.188464 24968 raft_consensus.cc:2454] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 940af9bf647c484a98faf4092b80d676 in term 0.
I20260811 07:28:56.189491 25045 leader_election.cc:302] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010f83a329a24342b03a5d831e198761, 940af9bf647c484a98faf4092b80d676; no voters:
I20260811 07:28:56.189917 25348 raft_consensus.cc:2781] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:28:56.190016 25348 raft_consensus.cc:482] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:28:56.190330 25348 raft_consensus.cc:3037] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:56.192219 25348 raft_consensus.cc:504] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:56.192633 25348 leader_election.cc:288] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [CANDIDATE]: Term 1 election: Requested vote from peers 010f83a329a24342b03a5d831e198761 (127.11.248.1:44001), 7fb8932c66ba45cfba999d031084c18a (127.11.248.3:39569)
I20260811 07:28:56.187180 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:56.169962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39569 (local address 127.11.248.2:40597)
0811 07:28:56.180858 (+ 10896us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:56.180876 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:28:56.181117 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:28:56.181550 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:28:56.181553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:28:56.181570 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:28:56.181807 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:56.181818 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.182978 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.182981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:56.184434 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:28:56.184445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.185614 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.185617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:28:56.185759 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:56.185784 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:28:56.186789 (+ 1005us) client_negotiation.cc:240] Negotiation successful
0811 07:28:56.186871 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10786,"thread_start_us":185,"threads_started":1}
I20260811 07:28:56.193416 24968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831e2dde11b441bb3f9f69d8e8294cd" candidate_uuid: "940af9bf647c484a98faf4092b80d676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010f83a329a24342b03a5d831e198761"
I20260811 07:28:56.193560 24968 raft_consensus.cc:3037] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:56.195462 24968 raft_consensus.cc:2454] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 940af9bf647c484a98faf4092b80d676 in term 1.
I20260811 07:28:56.195876 25045 leader_election.cc:302] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010f83a329a24342b03a5d831e198761, 940af9bf647c484a98faf4092b80d676; no voters:
I20260811 07:28:56.196062 25348 raft_consensus.cc:2781] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:28:56.196522 25348 raft_consensus.cc:686] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 1 LEADER]: Becoming Leader. State: Replica: 940af9bf647c484a98faf4092b80d676, State: Running, Role: LEADER
I20260811 07:28:56.196990 25348 consensus_queue.cc:237] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } }
I20260811 07:28:56.197610 25264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831e2dde11b441bb3f9f69d8e8294cd" candidate_uuid: "940af9bf647c484a98faf4092b80d676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fb8932c66ba45cfba999d031084c18a" is_pre_election: true
I20260811 07:28:56.197995 25264 raft_consensus.cc:2454] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 940af9bf647c484a98faf4092b80d676 in term 0.
I20260811 07:28:56.198472 25263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0831e2dde11b441bb3f9f69d8e8294cd" candidate_uuid: "940af9bf647c484a98faf4092b80d676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fb8932c66ba45cfba999d031084c18a"
I20260811 07:28:56.198684 25263 raft_consensus.cc:3037] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:28:56.200721 25263 raft_consensus.cc:2454] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 940af9bf647c484a98faf4092b80d676 in term 1.
I20260811 07:28:56.201423 24779 catalog_manager.cc:5495] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 reported cstate change: term changed from 0 to 1, leader changed from <none> to 940af9bf647c484a98faf4092b80d676 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "940af9bf647c484a98faf4092b80d676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "940af9bf647c484a98faf4092b80d676" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 } health_report { overall_health: UNKNOWN } } }
I20260811 07:28:56.230765 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:56.225305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42184 (local address 127.11.248.2:36983)
0811 07:28:56.225453 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:28:56.225458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:28:56.225474 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:28:56.225564 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:28:56.225567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:28:56.225638 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:28:56.225775 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:28:56.226087 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.226907 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.228345 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:28:56.228692 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:28:56.228792 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:28:56.229278 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:28:56.229864 (+ 586us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:28:56.229987 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:28:56.230433 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 07:28:56.230501 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:28:56.239701 25263 raft_consensus.cc:1261] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 1 FOLLOWER]: Refusing update from remote peer 940af9bf647c484a98faf4092b80d676: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:28:56.240442 24968 raft_consensus.cc:1261] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 1 FOLLOWER]: Refusing update from remote peer 940af9bf647c484a98faf4092b80d676: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:28:56.240738 25348 consensus_queue.cc:1035] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fb8932c66ba45cfba999d031084c18a" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:28:56.241735 25357 consensus_queue.cc:1035] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "010f83a329a24342b03a5d831e198761" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 07:28:56.253672 25362 mvcc.cc:205] Tried to move back new op lower bound from 7317230945228574720 to 7317230945066373120. Current Snapshot: MvccSnapshot[applied={T|T < 7317230945228574720}]
I20260811 07:28:56.254283 25363 mvcc.cc:205] Tried to move back new op lower bound from 7317230945228574720 to 7317230945066373120. Current Snapshot: MvccSnapshot[applied={T|T < 7317230945228574720}]
I20260811 07:28:56.269084 24779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:28:56.269544 24779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:28:56.273989 24779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3b0a276829245c08ac0a99eef7036b4: Sending DeleteTablet for 3 replicas of tablet 0831e2dde11b441bb3f9f69d8e8294cd
I20260811 07:28:56.275059 25091 tablet_service.cc:1514] Processing DeleteTablet for tablet 0831e2dde11b441bb3f9f69d8e8294cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:28:56 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:42168
I20260811 07:28:56.275157 24943 tablet_service.cc:1514] Processing DeleteTablet for tablet 0831e2dde11b441bb3f9f69d8e8294cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:28:56 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:36780
I20260811 07:28:56.275831 25379 tablet_replica.cc:330] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: stopping tablet replica
I20260811 07:28:56.276368 25379 raft_consensus.cc:2229] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:28:56.276974 25379 raft_consensus.cc:2258] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:28:56.278470 25243 tablet_service.cc:1514] Processing DeleteTablet for tablet 0831e2dde11b441bb3f9f69d8e8294cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:28:56 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:39120
I20260811 07:28:56.278649 25380 tablet_replica.cc:330] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761: stopping tablet replica
I20260811 07:28:56.279007 25380 raft_consensus.cc:2229] T 0831e2dde11b441bb3f9f69d8e8294cd P 010f83a329a24342b03a5d831e198761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:28:56.279253 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 24872
I20260811 07:28:56.286653 25379 ts_tablet_manager.cc:1905] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:28:56.290490 25379 ts_tablet_manager.cc:1918] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:28:56.290666 25379 log.cc:1196] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/0831e2dde11b441bb3f9f69d8e8294cd
I20260811 07:28:56.291116 25379 ts_tablet_manager.cc:1939] T 0831e2dde11b441bb3f9f69d8e8294cd P 940af9bf647c484a98faf4092b80d676: Deleting consensus metadata
I20260811 07:28:56.293098 25381 tablet_replica.cc:330] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: stopping tablet replica
I20260811 07:28:56.293164 24767 catalog_manager.cc:4841] TS 940af9bf647c484a98faf4092b80d676 (127.11.248.2:36983): tablet 0831e2dde11b441bb3f9f69d8e8294cd (table test-table [id=f4b858a0916348dc97b43cc60ded3b07]) successfully deleted
I20260811 07:28:56.293511 25381 raft_consensus.cc:2229] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:28:56.293910 25381 raft_consensus.cc:2258] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:28:56.295616 25381 ts_tablet_manager.cc:1905] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:28:56.298018 24765 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:44001 (error 108)
I20260811 07:28:56.298794 25381 ts_tablet_manager.cc:1918] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:28:56.298996 25381 log.cc:1196] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/0831e2dde11b441bb3f9f69d8e8294cd
I20260811 07:28:56.299490 25381 ts_tablet_manager.cc:1939] T 0831e2dde11b441bb3f9f69d8e8294cd P 7fb8932c66ba45cfba999d031084c18a: Deleting consensus metadata
I20260811 07:28:56.300247 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 25026
I20260811 07:28:56.305305 25383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:28:56.299839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44001 (local address 127.0.0.1:36796)
0811 07:28:56.305094 (+ 5255us) negotiation.cc:107] Waiting for socket to connect
0811 07:28:56.305188 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:44001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5156,"thread_start_us":85,"threads_started":1}
W20260811 07:28:56.305603 24765 catalog_manager.cc:4584] TS 010f83a329a24342b03a5d831e198761 (127.11.248.1:44001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0831e2dde11b441bb3f9f69d8e8294cd: Network error: Client connection negotiation failed: client connection to 127.11.248.1:44001: connect: Connection refused (error 111)
I20260811 07:28:56.305845 24765 catalog_manager.cc:4841] TS 7fb8932c66ba45cfba999d031084c18a (127.11.248.3:39569): tablet 0831e2dde11b441bb3f9f69d8e8294cd (table test-table [id=f4b858a0916348dc97b43cc60ded3b07]) successfully deleted
I20260811 07:28:56.307829 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 25173
I20260811 07:28:56.315412 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 24747
I20260811 07:28:56.326845 12256 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:28:56.673329 12256 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:28:56.673516 12256 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:28:57.019622 12256 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:28:57.019 UTC [24284] LOG: received smart shutdown request
2026-08-11 07:28:57.024 UTC [24284] LOG: background worker "logical replication launcher" (PID 24294) exited with exit code 1
2026-08-11 07:28:57.025 UTC [24288] LOG: shutting down
2026-08-11 07:28:57.191 UTC [24284] LOG: database system is shut down
2026-08-11T07:28:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54500 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:28:57 dist-test-slave-77v9 krb5kdc[25394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:28:57 dist-test-slave-77v9 krb5kdc[25394](info): set up 2 sockets
Aug 11 07:28:57 dist-test-slave-77v9 krb5kdc[25394](info): commencing operation
krb5kdc: starting...
W20260811 07:28:58.476447 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:28:58 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:28:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:28:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/rangeradmin_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/rangeradmin_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/rangerlookup_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/rangerlookup_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
I20260811 07:28:58.684381 12256 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMRD5fR/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/postgres -l logfile start
2026-08-11 07:29:01.617 UTC [25427] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:29:01.617 UTC [25427] LOG: listening on IPv4 address "127.11.248.20", port 59017
2026-08-11 07:29:01.622 UTC [25427] LOG: listening on Unix socket "/tmp/.s.PGSQL.59017"
2026-08-11 07:29:01.647 UTC [25430] LOG: database system was shut down at 2026-08-11 07:28:59 UTC
2026-08-11 07:29:01.651 UTC [25427] LOG: database system is ready to accept connections
I20260811 07:29:02.758065 12256 mini_postgres.cc:96] Postgres bound to 59017
2026-08-11 07:29:02.766 UTC [25438] FATAL: database "slave" does not exist
127.11.248.20:59017 - accepting connections
I20260811 07:29:02.766723 12256 mini_ranger.cc:161] Starting Ranger...
I20260811 07:29:02.785563 12256 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:29:03.381717 12256 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:29:03.381824 12256 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-admin
2026-08-11 07:29:03,663 [I] DB FLAVOR :POSTGRES
2026-08-11 07:29:03,664 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:29:03,664 [I] Checking connection..
2026-08-11 07:29:03,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:29:03,919 [I] Checking connection passed.
2026-08-11 07:29:03,919 [I] --------- Verifying version history table ---------
2026-08-11 07:29:03,919 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:29:04,186 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:29:04,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:29:04,465 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:29:04,465 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:29:04,465 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:29:04.735 UTC [25513] WARNING: there is no transaction in progress
2026-08-11 07:29:04,743 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:29:04,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:29:04,996 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:29:04,996 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:29:04,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:29:05,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:29:05,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-77v9.c.gcp-upstream.internal','N') ;"
2026-08-11 07:29:05,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:29:06,064 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:29:06,064 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:29:06,349 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:29:06,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:29:06,612 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:29:06,881 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:29:06,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:29:07.950 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:07.969 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:07.988 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.006 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.025 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.045 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.108 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.116 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.133 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.145 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.157 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.173 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.183 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.191 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.199 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08.207 UTC [25627] WARNING: there is no transaction in progress
2026-08-11 07:29:08,973 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:29:08,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:29:09,271 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:29:09,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:29:09,534 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:29:09,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:29:09,787 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:29:09,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:29:10,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:29:10,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-77v9.c.gcp-upstream.internal';"
2026-08-11 07:29:10,609 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:29:10,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:29:10,886 [I] DB_PATCHES have already been applied
I20260811 07:29:10.892869 12256 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMRD5fR/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:29:10.892964 12256 mini_ranger.cc:193] Using host: 127.11.248.20
I20260811 07:29:10.897769 12256 mini_ranger.cc:227] Ranger admin URL: http://127.11.248.20:38425
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:29:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:29:12.091032 12256 mini_ranger.cc:160] Time spent starting Ranger: real 9.324s user 0.004s sys 0.010s
Aug 11, 2026 7:29:34 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:29:34 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 7:29:34 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:29:34 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:29:35 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:29:35.910084 12256 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.248.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.248.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/rangerkms_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.248.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/rangerkms_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.248.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.248.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.248.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/HTTP_127.11.248.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:29:36 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433376, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:29:36.030340 12256 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:29:36.043748 12256 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:29:37.074666 12256 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:29:37.074769 12256 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms
I20260811 07:29:37.074792 12256 mini_ranger_kms.cc:227] Using postgres at 127.11.248.20:59017
2026-08-11 07:29:37,275 [I] DB FLAVOR :POSTGRES
2026-08-11 07:29:37,275 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:29:37,276 [I] Checking connection
2026-08-11 07:29:37,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:29:37,562 [I] connection success
2026-08-11 07:29:37,563 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:29:37,563 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:29:37,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:29:37,850 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:29:37,850 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:29:37,850 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:29:37,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.248.20:59017/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:29:38,149 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:29:38.687155 12256 mini_ranger_kms.cc:310] Created kms service
I20260811 07:29:38.932687 12256 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:29:38.981490 12256 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:29:38 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433376, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:39.432467 12256 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:29:39.432694 12256 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMRD5fR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMRD5fR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:29:39.432722 12256 mini_ranger_kms.cc:240] Using host: 127.11.248.20
I20260811 07:29:39.439635 12256 mini_ranger_kms.cc:276] Ranger KMS PID: 25835
I20260811 07:29:39.439754 12256 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.248.20:60191
Aug 11, 2026 7:29:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:29:40 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:29:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:29:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:29:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:29:41 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 07:29:42 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433382, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.248.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:42.046217 12256 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.016s user 0.025s sys 0.161s
I20260811 07:29:42.046377 12256 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:29:42.046452 12256 mini_ranger_kms.cc:401] 127.11.248.20:60191/kms/v1/keys
Aug 11 07:29:42 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433382, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.248.20@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
Aug 11 07:29:42 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433382, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.248.20@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
Aug 11 07:29:45 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:29:45.401684 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35813
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:35813
--ranger_config_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:45.531438 25887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:45.531805 25887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:45.531916 25887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:45.536221 25887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:45.536351 25887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:45.536389 25887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:45.536429 25887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:45.536469 25887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:45.542551 25887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.248.20:60191/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:35813
--ranger_config_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:45.543797 25887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:45.545047 25887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:45.555301 25893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:45.555289 25892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:45.555341 25895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:45.555580 25887 server_base.cc:1034] running on GCE node
I20260811 07:29:45.556366 25887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:45.557750 25887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:45.558949 25887 hybrid_clock.cc:648] HybridClock initialized: now 1786433385558910 us; error 57 us; skew 500 ppm
Aug 11 07:29:45 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:45.562296 25887 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:29:45.563383 25887 webserver.cc:460] Webserver started at http://127.11.248.62:33041/ using document root <none> and password file <none>
I20260811 07:29:45.564005 25887 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:45.564095 25887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:45.564330 25887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:29:45 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:45.630426 25887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "7f318bef79c2429b835deb1290240858"
format_stamp: "Formatted at 2026-08-11 07:29:45 on dist-test-slave-77v9"
server_key: "9c069a394c6f75a7adb422d6e2127db5"
server_key_iv: "6311e3d8d637eee6638fb31464642981"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:45.631295 25887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "7f318bef79c2429b835deb1290240858"
format_stamp: "Formatted at 2026-08-11 07:29:45 on dist-test-slave-77v9"
server_key: "9c069a394c6f75a7adb422d6e2127db5"
server_key_iv: "6311e3d8d637eee6638fb31464642981"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:45.637162 25887 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:29:45.653825 25902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:45.655589 25887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:45.655766 25887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "7f318bef79c2429b835deb1290240858"
format_stamp: "Formatted at 2026-08-11 07:29:45 on dist-test-slave-77v9"
server_key: "9c069a394c6f75a7adb422d6e2127db5"
server_key_iv: "6311e3d8d637eee6638fb31464642981"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:45.655926 25887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:45.676707 25887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:45.679840 25887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:45.680022 25887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:45.688125 25887 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:35813
I20260811 07:29:45.688140 25962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:35813 every 8 connection(s)
I20260811 07:29:45.689328 25887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:29:45.692440 25963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:45.692574 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 25887
I20260811 07:29:45.692683 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:29:45.693064 12256 external_mini_cluster.cc:1428] Setting key b62cb01366455f8d879e08fcc838579f
I20260811 07:29:45.699754 25963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Bootstrap starting.
I20260811 07:29:45.702819 25963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Neither blocks nor log segments found. Creating new log.
Aug 11 07:29:45 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:45.703683 25963 log.cc:824] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:45.705892 25963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: No bootstrap required, opened a new log
I20260811 07:29:45.709874 25967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:45.694558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50718 (local address 127.11.248.62:35813)
0811 07:29:45.695067 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:45.695092 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:45.695128 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:29:45.695877 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:45.695895 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:45.696235 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:45.696532 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:45.697615 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:45.698766 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:45.700035 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:45.700592 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:45.700731 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:45.704051 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:45.704057 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:45.704071 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:45.704101 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:45.706674 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:45.707263 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:45.707268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:45.707273 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:45.707394 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:45.707716 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:45.707718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:45.707719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:45.708183 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:45.708345 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:45.708655 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 07:29:45.709109 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":222,"threads_started":1}
I20260811 07:29:45.709812 25963 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:45.710157 25963 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:45.710217 25963 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f318bef79c2429b835deb1290240858, State: Initialized, Role: FOLLOWER
I20260811 07:29:45.710659 25963 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:45.710822 25963 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:29:45.710913 25963 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:29:45.711048 25963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:45.712296 25963 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:45.712656 25963 leader_election.cc:302] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f318bef79c2429b835deb1290240858; no voters:
I20260811 07:29:45.713052 25963 leader_election.cc:288] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:29:45.713362 25969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:29:45.713587 25969 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 LEADER]: Becoming Leader. State: Replica: 7f318bef79c2429b835deb1290240858, State: Running, Role: LEADER
I20260811 07:29:45.713991 25969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:45.714576 25963 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:29:45.715889 25971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f318bef79c2429b835deb1290240858. Latest consensus state: current_term: 1 leader_uuid: "7f318bef79c2429b835deb1290240858" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } } }
I20260811 07:29:45.716042 25971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:45.715889 25970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f318bef79c2429b835deb1290240858" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } } }
I20260811 07:29:45.716193 25970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:45.716516 25978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:29:45.717442 25963 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:29:45.722900 25978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:29:45.731472 25978 catalog_manager.cc:1347] Generated new cluster ID: d1008a422cee40dbae6ed7f740eb5037
I20260811 07:29:45.731559 25978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:29:45.751586 25978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:29:45.753180 25978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:29:45.768666 25978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Generated new TSK 0
I20260811 07:29:45.769717 25978 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:29:46.513916 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35813
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:46.676573 26012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:46.676970 26012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:46.677076 26012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:46.682344 26012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:46.682426 26012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:46.682519 26012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:29:46.690997 26012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.248.20:60191/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:46.692420 26012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:46.693953 26012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:46.707623 26020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:46.707877 26019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:46.707609 26022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:46.708894 26012 server_base.cc:1034] running on GCE node
I20260811 07:29:46.709470 26012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:46.710402 26012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:46.711629 26012 hybrid_clock.cc:648] HybridClock initialized: now 1786433386711592 us; error 52 us; skew 500 ppm
Aug 11 07:29:46 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433386, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:46.715752 26012 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:29:46.717136 26012 webserver.cc:460] Webserver started at http://127.11.248.1:45125/ using document root <none> and password file <none>
I20260811 07:29:46.717953 26012 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:46.718112 26012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:46.718449 26012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:29:46 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433386, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:46.739789 26012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1"
format_stamp: "Formatted at 2026-08-11 07:29:46 on dist-test-slave-77v9"
server_key: "0abfcd92e86248dc07e312657ff948de"
server_key_iv: "2be28c35be6c2ab44642a11939f31371"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:46.740643 26012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1"
format_stamp: "Formatted at 2026-08-11 07:29:46 on dist-test-slave-77v9"
server_key: "0abfcd92e86248dc07e312657ff948de"
server_key_iv: "2be28c35be6c2ab44642a11939f31371"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:46.746449 26012 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:29:46.765493 26029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:46.767375 26012 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:29:46.767525 26012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1"
format_stamp: "Formatted at 2026-08-11 07:29:46 on dist-test-slave-77v9"
server_key: "0abfcd92e86248dc07e312657ff948de"
server_key_iv: "2be28c35be6c2ab44642a11939f31371"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:46.767673 26012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:46.796155 26012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:46.800658 26012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:46.800992 26012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:46.801824 26012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:46.803072 26012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:46.803184 26012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:46.803284 26012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:46.803340 26012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:46.820976 26012 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:43345
I20260811 07:29:46.822379 26012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:29:46.828276 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26012
I20260811 07:29:46.828418 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:29:46.828722 12256 external_mini_cluster.cc:1428] Setting key 2095e7b8c24862f62dc9384f55d362f4
I20260811 07:29:46.833516 26159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:43345 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
Aug 11 07:29:46 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433386, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:29:46.850268 26163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:46.826006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:50765 (local address 127.11.248.62:35813)
0811 07:29:46.834062 (+ 8056us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:46.834067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:46.834627 (+ 560us) server_negotiation.cc:407] Connection header received
0811 07:29:46.835907 (+ 1280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:46.835912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:46.835977 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:46.836104 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:46.838389 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:46.839249 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:46.841111 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:46.841486 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:46.841586 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:46.845196 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:46.845200 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:46.845203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:46.845237 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:46.847383 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:46.848157 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:46.848161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:46.848163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:46.848277 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:46.848745 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:46.848748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:46.848750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:46.849053 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:46.849145 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:46.849898 (+ 753us) server_negotiation.cc:299] Negotiation successful
0811 07:29:46.850052 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7951,"thread_start_us":100,"threads_started":1}
I20260811 07:29:46.855562 26165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:46.826950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35813 (local address 127.11.248.1:50765)
0811 07:29:46.834389 (+ 7439us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:46.834462 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:46.835597 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:46.836473 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:46.836484 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:46.837359 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:46.838156 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:46.838188 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:46.839434 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:46.839440 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:46.840937 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:46.840952 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:46.841852 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:46.841857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:46.842077 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:46.843002 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:46.843025 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:46.844927 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:46.847592 (+ 2665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:46.847600 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:46.847620 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:46.848022 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:46.848407 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:46.848410 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:46.848412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:46.848625 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:46.849218 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:46.849225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:46.849597 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 07:29:46.850539 (+ 942us) client_negotiation.cc:240] Negotiation successful
0811 07:29:46.850927 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7161,"thread_start_us":182,"threads_started":1}
I20260811 07:29:46.857640 26161 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35813
I20260811 07:29:46.857940 26161 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:46.858631 26161 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:46.860796 25923 ts_manager.cc:194] Registered new tserver with Master: 8f68dafb3dbb414aa46b66e9ffa38ae1 (127.11.248.1:43345)
I20260811 07:29:46.862558 25923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:50765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:29:46.872539 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35813
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:29:46 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433386, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:29:47.043447 26168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:47.043879 26168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:47.043952 26168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:47.050596 26168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:47.050706 26168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:47.050799 26168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:29:47.059370 26168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.248.20:60191/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:47.060938 26168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:47.062410 26168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:47.075654 26174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:47.076128 26175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:47.076184 26168 server_base.cc:1034] running on GCE node
W20260811 07:29:47.075685 26177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:47.076781 26168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:47.077687 26168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:47.078904 26168 hybrid_clock.cc:648] HybridClock initialized: now 1786433387078876 us; error 46 us; skew 500 ppm
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:47.082896 26168 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:29:47.084246 26168 webserver.cc:460] Webserver started at http://127.11.248.2:46803/ using document root <none> and password file <none>
I20260811 07:29:47.085103 26168 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:47.085216 26168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:47.085508 26168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:47.103827 26168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "d896caeab2bc4e77bad469fbfa9f5abb"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "23403768f7813fbd3b58979b9039125b"
server_key_iv: "bf8b7d5f2fee1bd59ef8fcd35091cbca"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.104797 26168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "d896caeab2bc4e77bad469fbfa9f5abb"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "23403768f7813fbd3b58979b9039125b"
server_key_iv: "bf8b7d5f2fee1bd59ef8fcd35091cbca"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.110601 26168 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260811 07:29:47.141357 26184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.143312 26168 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.002s sys 0.001s
I20260811 07:29:47.143514 26168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "d896caeab2bc4e77bad469fbfa9f5abb"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "23403768f7813fbd3b58979b9039125b"
server_key_iv: "bf8b7d5f2fee1bd59ef8fcd35091cbca"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.143676 26168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:47.160696 26168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:47.164247 26168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:47.164484 26168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:47.165251 26168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:47.166214 26168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:47.166289 26168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.166355 26168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:47.166384 26168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.178120 26168 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:44851
I20260811 07:29:47.178208 26310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:44851 every 8 connection(s)
I20260811 07:29:47.179335 26168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:29:47.185864 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26168
I20260811 07:29:47.186012 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:29:47.186362 12256 external_mini_cluster.cc:1428] Setting key 096a1d42ddab15971172bdb1ba133871
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:29:47.206853 26163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:47.183330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:37061 (local address 127.11.248.62:35813)
0811 07:29:47.183474 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:47.183479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:47.191121 (+ 7642us) server_negotiation.cc:407] Connection header received
0811 07:29:47.192393 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:47.192396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:47.192456 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:47.192558 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:47.194572 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.195454 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.197565 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.198026 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.198139 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:47.201865 (+ 3726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:47.201871 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:47.201874 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:47.201913 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:47.203815 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:47.204441 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:47.204445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:47.204447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:47.204537 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:47.205102 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:47.205106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:47.205108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:47.205332 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:47.205452 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:47.206359 (+ 907us) server_negotiation.cc:299] Negotiation successful
0811 07:29:47.206562 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:29:47.209234 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:47.182128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35813 (local address 127.11.248.2:37061)
0811 07:29:47.190907 (+ 8779us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:47.190979 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:47.192126 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:47.192984 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:47.192999 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:47.193477 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:47.194359 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:47.194387 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.195650 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.195656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:47.197372 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:47.197389 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.198448 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.198453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:47.198726 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:47.199569 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:47.199597 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:47.201589 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:47.203968 (+ 2379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:47.203975 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:47.203996 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:47.204306 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:47.204642 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:47.204699 (+ 57us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:47.204704 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:47.204983 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:47.205496 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:47.205507 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:47.206016 (+ 509us) client_negotiation.cc:769] Sending connection context
0811 07:29:47.207447 (+ 1431us) client_negotiation.cc:240] Negotiation successful
0811 07:29:47.207911 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8446,"thread_start_us":159,"threads_started":1}
I20260811 07:29:47.211112 26311 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35813
I20260811 07:29:47.211439 26311 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:47.212210 26311 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:47.213622 25923 ts_manager.cc:194] Registered new tserver with Master: d896caeab2bc4e77bad469fbfa9f5abb (127.11.248.2:44851)
I20260811 07:29:47.214560 25923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:37061
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:29:47.231817 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35813
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433386, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
W20260811 07:29:47.416338 26316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:47.416754 26316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:47.416857 26316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:47.422964 26316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:47.423062 26316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:47.423149 26316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:29:47.431351 26316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.248.20:60191/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:47.433396 26316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:47.436105 26316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:47.450163 26322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:47.450618 26324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:47.450794 26321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:47.451102 26316 server_base.cc:1034] running on GCE node
I20260811 07:29:47.451673 26316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:47.452587 26316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:47.453795 26316 hybrid_clock.cc:648] HybridClock initialized: now 1786433387453764 us; error 43 us; skew 500 ppm
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:47.457942 26316 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:29:47.459278 26316 webserver.cc:460] Webserver started at http://127.11.248.3:33371/ using document root <none> and password file <none>
I20260811 07:29:47.459928 26316 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:47.460054 26316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:47.460290 26316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:47.478363 26316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "f2e5d7a0383a438f8d22afcb3fc0c308"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "e195db597b2e218a9fb24d6798626d8a"
server_key_iv: "b3e8ec5043fb73f69013627bf52f6966"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.479702 26316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "f2e5d7a0383a438f8d22afcb3fc0c308"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "e195db597b2e218a9fb24d6798626d8a"
server_key_iv: "b3e8ec5043fb73f69013627bf52f6966"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.494571 26316 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.004s sys 0.000s
I20260811 07:29:47.516321 26332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.518352 26316 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260811 07:29:47.518527 26316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "f2e5d7a0383a438f8d22afcb3fc0c308"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "e195db597b2e218a9fb24d6798626d8a"
server_key_iv: "b3e8ec5043fb73f69013627bf52f6966"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.518705 26316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:47.536242 26316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:47.540155 26316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:47.540380 26316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:47.541213 26316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:47.542387 26316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:47.542469 26316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.542595 26316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:47.542655 26316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.555655 26316 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:40535
I20260811 07:29:47.557071 26466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:40535 every 8 connection(s)
I20260811 07:29:47.557278 26316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:29:47.565521 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26316
I20260811 07:29:47.565682 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:29:47.566010 12256 external_mini_cluster.cc:1428] Setting key cbbff17351040ba0b598674db24847a0
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:47.577719 26163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:47.560215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:60943 (local address 127.11.248.62:35813)
0811 07:29:47.560373 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:47.560379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:47.561629 (+ 1250us) server_negotiation.cc:407] Connection header received
0811 07:29:47.563095 (+ 1466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:47.563100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:47.563165 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:47.563223 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:47.565114 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.565941 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.568021 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.568376 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.568468 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:47.572217 (+ 3749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:47.572222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:47.572225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:47.572258 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:47.574393 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:47.575391 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:47.575395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:47.575397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:47.575506 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:47.576047 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:47.576051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:47.576052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:47.576306 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:47.576395 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:47.577329 (+ 934us) server_negotiation.cc:299] Negotiation successful
0811 07:29:47.577518 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:29:47.579877 26470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:47.560745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35813 (local address 127.11.248.3:60943)
0811 07:29:47.561445 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:47.561510 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:47.562798 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:47.563680 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:47.563690 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:47.564118 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:47.564883 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:47.564908 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.566148 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.566152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:47.567843 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:47.567855 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:47.568703 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:47.568708 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:47.568997 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:47.569804 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:47.569827 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:47.571898 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:47.574600 (+ 2702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:47.574609 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:47.574631 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:47.575206 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:47.575644 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:47.575648 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:47.575650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:47.575886 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:47.576493 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:47.576501 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:47.576941 (+ 440us) client_negotiation.cc:769] Sending connection context
0811 07:29:47.578107 (+ 1166us) client_negotiation.cc:240] Negotiation successful
0811 07:29:47.578546 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":183,"threads_started":1}
I20260811 07:29:47.581820 26467 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35813
I20260811 07:29:47.582165 26467 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:47.582888 26467 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:47.584501 25923 ts_manager.cc:194] Registered new tserver with Master: f2e5d7a0383a438f8d22afcb3fc0c308 (127.11.248.3:40535)
I20260811 07:29:47.585418 25923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:60943
I20260811 07:29:47.593627 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:29:47.595369 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26012
I20260811 07:29:47.606350 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26168
I20260811 07:29:47.629403 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26316
I20260811 07:29:47.640259 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 25887
I20260811 07:29:47.651448 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35813
--webserver_interface=127.11.248.62
--webserver_port=33041
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:35813
--ranger_config_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:47.773871 26471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:47.774274 26471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:47.774359 26471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:47.778719 26471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:47.778841 26471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:47.778880 26471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:47.778939 26471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:47.778995 26471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:47.785071 26471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:35813
--ranger_config_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=33041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:47.786384 26471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:47.787523 26471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:47.796697 26477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:47.796702 26476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:47.796697 26479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:47.797017 26471 server_base.cc:1034] running on GCE node
I20260811 07:29:47.797750 26471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:47.798997 26471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:47.800221 26471 hybrid_clock.cc:648] HybridClock initialized: now 1786433387800189 us; error 48 us; skew 500 ppm
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:47.803478 26471 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:29:47.804482 26471 webserver.cc:460] Webserver started at http://127.11.248.62:33041/ using document root <none> and password file <none>
I20260811 07:29:47.805138 26471 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:47.805243 26471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:29:47 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:47.892292 26471 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:47.895066 26488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:47.896571 26471 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:29:47.896749 26471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "7f318bef79c2429b835deb1290240858"
format_stamp: "Formatted at 2026-08-11 07:29:45 on dist-test-slave-77v9"
server_key: "9c069a394c6f75a7adb422d6e2127db5"
server_key_iv: "6311e3d8d637eee6638fb31464642981"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:47.897454 26471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:47.912261 26471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:47.915508 26471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:47.915741 26471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:47.923799 26471 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:35813
I20260811 07:29:47.923822 26548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:35813 every 8 connection(s)
I20260811 07:29:47.925051 26471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:29:47.929611 26550 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:29:47.931653 26550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Bootstrap starting.
I20260811 07:29:47.932364 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26471
I20260811 07:29:47.932886 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:43345
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:35813
--webserver_port=45125
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:29:47.950567 26550 log.cc:824] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:47.958287 26550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:29:47.958770 26550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Bootstrap complete.
I20260811 07:29:47.963627 26550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:47.964056 26550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f318bef79c2429b835deb1290240858, State: Initialized, Role: FOLLOWER
I20260811 07:29:47.964579 26550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:47.964707 26550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:29:47.964800 26550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:29:47.964933 26550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:29:47.967089 26550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:47.967444 26550 leader_election.cc:302] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f318bef79c2429b835deb1290240858; no voters:
I20260811 07:29:47.967860 26550 leader_election.cc:288] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:29:47.967937 26554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:29:47.968182 26554 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [term 2 LEADER]: Becoming Leader. State: Replica: 7f318bef79c2429b835deb1290240858, State: Running, Role: LEADER
I20260811 07:29:47.968533 26554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } }
I20260811 07:29:47.969255 26550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:29:47.969628 26555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f318bef79c2429b835deb1290240858. Latest consensus state: current_term: 2 leader_uuid: "7f318bef79c2429b835deb1290240858" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } } }
I20260811 07:29:47.969763 26555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:47.970024 26556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7f318bef79c2429b835deb1290240858" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f318bef79c2429b835deb1290240858" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35813 } } }
I20260811 07:29:47.970127 26556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:47.970185 26559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:29:47.973845 26559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:29:47.974529 26550 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:29:47.974617 26559 catalog_manager.cc:1259] Loaded cluster ID: d1008a422cee40dbae6ed7f740eb5037
I20260811 07:29:47.974808 26559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:29:47.977788 26559 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:29:47.978714 26559 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Loaded TSK: 0
I20260811 07:29:47.980070 26559 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:29:48.084693 26552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:48.085139 26552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:48.085210 26552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:48.092070 26552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:48.092175 26552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:48.092279 26552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:29:48.100555 26552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:43345
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=45125
--tserver_master_addrs=127.11.248.62:35813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:48.102105 26552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:48.103600 26552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:48.117590 26596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:48.117830 26597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:48.118332 26552 server_base.cc:1034] running on GCE node
W20260811 07:29:48.118227 26600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:48.118971 26552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:48.119802 26552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:48.120995 26552 hybrid_clock.cc:648] HybridClock initialized: now 1786433388120964 us; error 46 us; skew 500 ppm
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:48.124931 26552 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:29:48.126155 26552 webserver.cc:460] Webserver started at http://127.11.248.1:45125/ using document root <none> and password file <none>
I20260811 07:29:48.126958 26552 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:48.127079 26552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:48.154733 26552 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:29:48.158347 26611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.160127 26552 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:29:48.160367 26552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1"
format_stamp: "Formatted at 2026-08-11 07:29:46 on dist-test-slave-77v9"
server_key: "0abfcd92e86248dc07e312657ff948de"
server_key_iv: "2be28c35be6c2ab44642a11939f31371"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:48.161223 26552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:48.175444 26552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:48.179028 26552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:48.179262 26552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:48.180114 26552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:48.181274 26552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:48.181348 26552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.181408 26552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:48.181442 26552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.193018 26552 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:43345
I20260811 07:29:48.193452 26743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:43345 every 8 connection(s)
I20260811 07:29:48.194224 26552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:29:48.202919 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26552
I20260811 07:29:48.203457 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:44851
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:35813
--webserver_port=46803
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:48.214958 26749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.196743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35813 (local address 127.11.248.1:35421)
0811 07:29:48.197628 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:48.197691 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:48.198546 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:48.199756 (+ 1210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:48.199764 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:48.200149 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:48.200614 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:48.200628 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.202406 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.202410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:48.204265 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:48.204282 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.205798 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.205805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:48.206031 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.206865 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:48.206891 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:48.208599 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:48.211098 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:48.211105 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:48.211120 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:48.211406 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:48.211797 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:48.211800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:48.211803 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:48.211961 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:48.212891 (+ 930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:48.212907 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:48.213232 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 07:29:48.213450 (+ 218us) client_negotiation.cc:240] Negotiation successful
0811 07:29:48.213823 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":134,"threads_started":1}
I20260811 07:29:48.216960 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.196610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:35421 (local address 127.11.248.62:35813)
0811 07:29:48.197328 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:48.197353 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:48.197832 (+ 479us) server_negotiation.cc:407] Connection header received
0811 07:29:48.198998 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:48.199008 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:48.199357 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:48.199683 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:48.200879 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.202226 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.204452 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.205268 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.205475 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.208911 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:48.208917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:48.208931 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:48.208963 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:48.210952 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.211556 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.211561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.211565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.211684 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.212063 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.212067 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.212069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.212654 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:48.212788 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:48.215569 (+ 2781us) server_negotiation.cc:299] Negotiation successful
0811 07:29:48.215923 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":163,"threads_started":1}
I20260811 07:29:48.220605 26745 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35813
I20260811 07:29:48.220973 26745 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.221637 26745 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
W20260811 07:29:48.224184 26745 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:35813 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:29:48.224340 26745 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.224582 26745 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:48.225574 26745 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.225785 26745 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
W20260811 07:29:48.226629 26745 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:29:48.398473 26750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:48.398967 26750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:48.399060 26750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:48.405578 26750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:48.405666 26750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:48.405758 26750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:29:48.415484 26750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:44851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=46803
--tserver_master_addrs=127.11.248.62:35813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:48.417076 26750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:48.418530 26750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:48.433179 26757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:48.433779 26760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:48.434089 26758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:48.434094 26750 server_base.cc:1034] running on GCE node
I20260811 07:29:48.434768 26750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:48.435716 26750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:48.439340 26750 hybrid_clock.cc:648] HybridClock initialized: now 1786433388439240 us; error 103 us; skew 500 ppm
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:48.443755 26750 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:29:48.445168 26750 webserver.cc:460] Webserver started at http://127.11.248.2:46803/ using document root <none> and password file <none>
I20260811 07:29:48.446010 26750 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:48.446187 26750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:48.492463 26750 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:29:48.513868 26769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.515861 26750 fs_manager.cc:725] Time spent opening block manager: real 0.021s user 0.003s sys 0.000s
I20260811 07:29:48.516024 26750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "d896caeab2bc4e77bad469fbfa9f5abb"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "23403768f7813fbd3b58979b9039125b"
server_key_iv: "bf8b7d5f2fee1bd59ef8fcd35091cbca"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:48.516891 26750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:48.533851 26750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:48.540037 26750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:48.540417 26750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:48.541311 26750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:48.542493 26750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:48.542608 26750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.542716 26750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:48.542826 26750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.554636 26750 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:44851
I20260811 07:29:48.556180 26750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:29:48.556563 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26750
I20260811 07:29:48.557145 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.248.20:60191/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:40535
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:35813
--webserver_port=33371
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:29:48.567173 26897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:44851 every 8 connection(s)
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:48.595364 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.570959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:38703 (local address 127.11.248.62:35813)
0811 07:29:48.571112 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:48.571117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:48.571668 (+ 551us) server_negotiation.cc:407] Connection header received
0811 07:29:48.580753 (+ 9085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:48.580758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:48.580863 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:48.580930 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:48.583024 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.583987 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.585983 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.586393 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.586503 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.590366 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:48.590371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:48.590374 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:48.590410 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:48.592480 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.593277 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.593283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.593287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.593391 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.593860 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.593864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.593866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.594125 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:48.594215 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:48.595003 (+ 788us) server_negotiation.cc:299] Negotiation successful
0811 07:29:48.595166 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:29:48.597484 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.568399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35813 (local address 127.11.248.2:38703)
0811 07:29:48.571475 (+ 3076us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:48.571540 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:48.580379 (+ 8839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:48.581439 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:48.581451 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:48.581895 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:48.582699 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:48.582721 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.584182 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.584185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:48.585797 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:48.585820 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.586752 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.586757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:48.586995 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.587840 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:48.587872 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:48.590110 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:48.592642 (+ 2532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:48.592650 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:48.592673 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:48.593139 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:48.593512 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:48.593515 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:48.593517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:48.593720 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:48.594288 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:48.594297 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:48.594676 (+ 379us) client_negotiation.cc:769] Sending connection context
0811 07:29:48.595929 (+ 1253us) client_negotiation.cc:240] Negotiation successful
0811 07:29:48.596321 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2825,"thread_start_us":173,"threads_started":1}
I20260811 07:29:48.599634 26898 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35813
I20260811 07:29:48.599902 26898 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.600502 26898 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
W20260811 07:29:48.602381 26898 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:35813 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:29:48.602507 26898 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.602686 26898 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:48.603623 26898 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.603796 26898 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
W20260811 07:29:48.604638 26898 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:29:48.728919 26901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:48.729350 26901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:48.729444 26901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:48.735491 26901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:48.735605 26901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:48.735718 26901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:29:48.742779 26901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.248.20:60191/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:40535
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=33371
--tserver_master_addrs=127.11.248.62:35813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:48.744130 26901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:48.745391 26901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:48.761672 26909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:48.762014 26910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:48.762236 26914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:48.762634 26901 server_base.cc:1034] running on GCE node
I20260811 07:29:48.763170 26901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:48.764055 26901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:48.765235 26901 hybrid_clock.cc:648] HybridClock initialized: now 1786433388765201 us; error 55 us; skew 500 ppm
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:48.768942 26901 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:29:48.770167 26901 webserver.cc:460] Webserver started at http://127.11.248.3:33371/ using document root <none> and password file <none>
I20260811 07:29:48.770865 26901 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:48.770989 26901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:48.798483 26901 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:29:48.801900 26922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.803660 26901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:29:48.803817 26901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "f2e5d7a0383a438f8d22afcb3fc0c308"
format_stamp: "Formatted at 2026-08-11 07:29:47 on dist-test-slave-77v9"
server_key: "e195db597b2e218a9fb24d6798626d8a"
server_key_iv: "b3e8ec5043fb73f69013627bf52f6966"
server_key_version: "kuduclusterkey@0"
I20260811 07:29:48.804584 26901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:48.823570 26901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:48.827597 26901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:48.827819 26901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:48.828616 26901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:48.829811 26901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:48.829885 26901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.829942 26901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:48.829977 26901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:48.843159 26901 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:40535
I20260811 07:29:48.844602 26901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:29:48.845963 27051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:40535 every 8 connection(s)
I20260811 07:29:48.846421 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 26901
Aug 11 07:29:48 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:48.863790 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.847419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:39447 (local address 127.11.248.62:35813)
0811 07:29:48.847570 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:48.847575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:48.848760 (+ 1185us) server_negotiation.cc:407] Connection header received
0811 07:29:48.850465 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:48.850470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:48.850553 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:48.850658 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:48.852397 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.853058 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.854309 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.854738 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.854977 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.858370 (+ 3393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:48.858376 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:48.858379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:48.858434 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:48.860683 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.861535 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.861540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.861542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.861643 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.862176 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.862182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.862184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.862469 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:48.862570 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:48.863422 (+ 852us) server_negotiation.cc:299] Negotiation successful
0811 07:29:48.863591 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:29:48.864367 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.849413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48518 (local address 127.11.248.62:35813)
0811 07:29:48.850652 (+ 1239us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:48.850667 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:48.850957 (+ 290us) server_negotiation.cc:407] Connection header received
0811 07:29:48.851180 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:48.851183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:48.851234 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:48.851310 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:48.852461 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.853319 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.854597 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.854948 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.855036 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.858107 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:48.858112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:48.858115 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:48.858150 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:48.860655 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.861908 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.861912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.861914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.862040 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:48.862623 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:48.862628 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:48.862630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:48.862999 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:48.863305 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:48.863907 (+ 602us) server_negotiation.cc:299] Negotiation successful
0811 07:29:48.864094 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1157,"thread_start_us":118,"threads_started":1}
I20260811 07:29:48.866101 27055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:48.847992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35813 (local address 127.11.248.3:39447)
0811 07:29:48.848570 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:48.848634 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:48.850172 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:48.851049 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:48.851061 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:48.851438 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:48.852157 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:48.852207 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.853191 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.853196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:48.854163 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:48.854172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:48.855189 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:48.855195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:48.855437 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:48.856057 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:48.856082 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:48.858153 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:48.860899 (+ 2746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:48.860907 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:48.860929 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:48.861391 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:48.861782 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:48.861787 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:48.861789 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:48.862040 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:48.862658 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:48.862665 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:48.863064 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 07:29:48.864083 (+ 1019us) client_negotiation.cc:240] Negotiation successful
0811 07:29:48.864518 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":153,"threads_started":1}
I20260811 07:29:48.867527 27052 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35813
I20260811 07:29:48.867784 27052 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.868413 27052 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
W20260811 07:29:48.870302 27052 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:35813 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:29:48.870437 27052 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.870694 27052 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:48.871582 27052 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:48.871767 27052 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
W20260811 07:29:48.872519 27052 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:29:49.226893 26745 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:49.227279 26745 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:49.228688 26505 ts_manager.cc:194] Registered new tserver with Master: 8f68dafb3dbb414aa46b66e9ffa38ae1 (127.11.248.1:43345)
I20260811 07:29:49.230192 26505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:35421
Aug 11 07:29:49 dist-test-slave-77v9 krb5kdc[25394](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:49.604919 26898 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:49.605288 26898 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:49.606172 26505 ts_manager.cc:194] Registered new tserver with Master: d896caeab2bc4e77bad469fbfa9f5abb (127.11.248.2:44851)
I20260811 07:29:49.607000 26505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:38703
Aug 11 07:29:49 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
I20260811 07:29:49.872768 27052 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:49.873145 27052 heartbeater.cc:511] Master 127.11.248.62:35813 requested a full tablet report, sending...
I20260811 07:29:49.873991 26505 ts_manager.cc:194] Registered new tserver with Master: f2e5d7a0383a438f8d22afcb3fc0c308 (127.11.248.3:40535)
I20260811 07:29:49.874600 26505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:39447
I20260811 07:29:49.882360 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:29:49.892765 27080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.884074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48520 (local address 127.11.248.62:35813)
0811 07:29:49.884375 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:49.884379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:49.884607 (+ 228us) server_negotiation.cc:407] Connection header received
0811 07:29:49.884775 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:49.884778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:49.884862 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:49.884972 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:49.885720 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.886301 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.887169 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.887429 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.887546 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.889155 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:49.889159 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:49.889161 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:49.889198 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:49.890875 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:49.891371 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:49.891375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:49.891376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:49.891469 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:49.891766 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:49.891770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:49.891772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:49.891973 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:49.892118 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:49.892377 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 07:29:49.892517 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":114,"threads_started":1}
I20260811 07:29:49.896994 26505 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48520:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:29:49.900672 26505 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:29:49.928047 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.912609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:40535 (local address 127.0.0.1:59578)
0811 07:29:49.916665 (+ 4056us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:49.916682 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:49.916784 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:49.917844 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:49.917851 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:49.917875 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:49.918048 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:49.918057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.919524 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.919528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:49.921991 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:49.922001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.927372 (+ 5371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.927379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:49.927517 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.927564 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:29:49.927694 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 07:29:49.927865 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3976,"mutex_wait_us":98,"thread_start_us":99,"threads_started":1}
I20260811 07:29:49.928408 27088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.912238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:43345 (local address 127.0.0.1:57162)
0811 07:29:49.914021 (+ 1783us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:49.914082 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:49.914214 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:49.919651 (+ 5437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:49.919654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:49.919671 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:49.919863 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:49.919869 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.921391 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.921394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:49.922482 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:49.922492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.927970 (+ 5478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.927974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:49.928082 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.928111 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:29:49.928193 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:29:49.928271 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1343,"thread_start_us":155,"threads_started":1}
I20260811 07:29:49.929224 27089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.913170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59578 (local address 127.11.248.3:40535)
0811 07:29:49.917352 (+ 4182us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:49.917361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:49.917388 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:29:49.917481 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:49.917486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:49.917672 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:49.917850 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:49.918195 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.919383 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.922137 (+ 2754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.923220 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.923414 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.923576 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:49.928952 (+ 5376us) server_negotiation.cc:299] Negotiation successful
0811 07:29:49.929079 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4057,"thread_start_us":86,"threads_started":1}
I20260811 07:29:49.932791 26974 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac43775bb1944518d7c747f66530095 (DEFAULT_TABLE table=test-table [id=d16d7cfbc3b748a09f8ba4ce1761da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:29:49.934269 26974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac43775bb1944518d7c747f66530095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:49.946063 27090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.913292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40760 (local address 127.11.248.2:44851)
0811 07:29:49.917121 (+ 3829us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:49.917131 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:49.918356 (+ 1225us) server_negotiation.cc:407] Connection header received
0811 07:29:49.918439 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:49.918444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:49.918628 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:49.918762 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:49.922823 (+ 4061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.923950 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.925436 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.926274 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.926394 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.926594 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:49.945741 (+ 19147us) server_negotiation.cc:299] Negotiation successful
0811 07:29:49.945891 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3703,"thread_start_us":69,"threads_started":1}
I20260811 07:29:49.946596 27085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.913115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:44851 (local address 127.0.0.1:40760)
0811 07:29:49.918139 (+ 5024us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:49.918156 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:49.918244 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:49.919982 (+ 1738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:49.919984 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:49.920001 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:49.922681 (+ 2680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:49.922688 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.924079 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.924083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:49.925288 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:49.925298 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.945351 (+ 20053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.945361 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:49.945502 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.945535 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:29:49.946317 (+ 782us) client_negotiation.cc:240] Negotiation successful
0811 07:29:49.946433 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4946,"mutex_wait_us":2571,"thread_start_us":93,"threads_started":1}
I20260811 07:29:49.948145 27086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:49.912391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57162 (local address 127.11.248.1:43345)
0811 07:29:49.919101 (+ 6710us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:49.919108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:49.919130 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:29:49.919198 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:49.919202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:49.919370 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:49.919506 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:49.920075 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.921244 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.926828 (+ 5584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:49.927668 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:49.927769 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:49.927907 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:49.947845 (+ 19938us) server_negotiation.cc:299] Negotiation successful
0811 07:29:49.947986 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6577,"thread_start_us":98,"threads_started":1}
I20260811 07:29:49.950168 26812 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac43775bb1944518d7c747f66530095 (DEFAULT_TABLE table=test-table [id=d16d7cfbc3b748a09f8ba4ce1761da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:29:49.950917 26667 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac43775bb1944518d7c747f66530095 (DEFAULT_TABLE table=test-table [id=d16d7cfbc3b748a09f8ba4ce1761da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:29:49.951421 26812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac43775bb1944518d7c747f66530095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:49.951911 26667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac43775bb1944518d7c747f66530095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:49.957216 27091 tablet_bootstrap.cc:492] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Bootstrap starting.
I20260811 07:29:49.962142 27093 tablet_bootstrap.cc:492] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Bootstrap starting.
I20260811 07:29:49.962510 27092 tablet_bootstrap.cc:492] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: Bootstrap starting.
I20260811 07:29:49.964679 27091 tablet_bootstrap.cc:654] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:49.965606 27093 tablet_bootstrap.cc:654] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:49.965606 27092 tablet_bootstrap.cc:654] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:49.967123 27093 log.cc:824] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:49.967131 27092 log.cc:824] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:49.968253 27091 log.cc:824] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:49.970458 27092 tablet_bootstrap.cc:492] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: No bootstrap required, opened a new log
I20260811 07:29:49.970733 27092 ts_tablet_manager.cc:1397] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:29:49.971096 27093 tablet_bootstrap.cc:492] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: No bootstrap required, opened a new log
I20260811 07:29:49.971511 27093 ts_tablet_manager.cc:1397] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260811 07:29:49.978592 27093 raft_consensus.cc:348] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:49.978596 27092 raft_consensus.cc:348] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:49.978969 27093 raft_consensus.cc:374] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:49.978969 27092 raft_consensus.cc:374] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:49.979043 27092 raft_consensus.cc:729] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f68dafb3dbb414aa46b66e9ffa38ae1, State: Initialized, Role: FOLLOWER
I20260811 07:29:49.979041 27093 raft_consensus.cc:729] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d896caeab2bc4e77bad469fbfa9f5abb, State: Initialized, Role: FOLLOWER
I20260811 07:29:49.979795 27093 consensus_queue.cc:260] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:49.979851 27092 consensus_queue.cc:260] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:49.981531 27092 ts_tablet_manager.cc:1428] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260811 07:29:49.981531 27093 ts_tablet_manager.cc:1428] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260811 07:29:49.981973 26745 heartbeater.cc:503] Master 127.11.248.62:35813 was elected leader, sending a full tablet report...
I20260811 07:29:49.981973 26898 heartbeater.cc:503] Master 127.11.248.62:35813 was elected leader, sending a full tablet report...
I20260811 07:29:49.986541 27091 tablet_bootstrap.cc:492] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: No bootstrap required, opened a new log
I20260811 07:29:49.986835 27091 ts_tablet_manager.cc:1397] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.000s
I20260811 07:29:49.993997 27091 raft_consensus.cc:348] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:49.994412 27091 raft_consensus.cc:374] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:49.994498 27091 raft_consensus.cc:729] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e5d7a0383a438f8d22afcb3fc0c308, State: Initialized, Role: FOLLOWER
I20260811 07:29:49.995160 27091 consensus_queue.cc:260] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:49.996105 27052 heartbeater.cc:503] Master 127.11.248.62:35813 was elected leader, sending a full tablet report...
I20260811 07:29:49.996624 27091 ts_tablet_manager.cc:1428] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
Aug 11 07:29:50 dist-test-slave-77v9 krb5kdc[25394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for HTTP/127.11.248.20@KRBTEST.COM
W20260811 07:29:50.068506 26900 tablet.cc:2369] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:29:50.096984 27053 tablet.cc:2369] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:29:50.198150 26747 tablet.cc:2369] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:29:50.246609 27098 raft_consensus.cc:482] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:29:50.246973 27098 raft_consensus.cc:504] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:50.248407 27098 leader_election.cc:288] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f68dafb3dbb414aa46b66e9ffa38ae1 (127.11.248.1:43345), f2e5d7a0383a438f8d22afcb3fc0c308 (127.11.248.3:40535)
I20260811 07:29:50.265255 27089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:50.250003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:41763 (local address 127.11.248.3:40535)
0811 07:29:50.250122 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:50.250127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:50.256683 (+ 6556us) server_negotiation.cc:407] Connection header received
0811 07:29:50.256996 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:50.257000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:50.257053 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:50.257099 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:50.258051 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.258820 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.263890 (+ 5070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.264451 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.264548 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:50.264601 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:50.265029 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 07:29:50.265118 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:29:50.265859 27102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:50.249408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:40535 (local address 127.11.248.2:41763)
0811 07:29:50.256524 (+ 7116us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:50.256545 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:50.256843 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:50.257248 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:50.257251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:50.257272 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:50.257570 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:50.257577 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.258973 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.258976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:50.260478 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:50.260490 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.264693 (+ 4203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.264696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:50.264880 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:50.264905 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:29:50.265507 (+ 602us) client_negotiation.cc:240] Negotiation successful
0811 07:29:50.265587 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7016,"thread_start_us":184,"threads_started":1}
I20260811 07:29:50.266810 26977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac43775bb1944518d7c747f66530095" candidate_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" is_pre_election: true
I20260811 07:29:50.267200 26977 raft_consensus.cc:2454] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d896caeab2bc4e77bad469fbfa9f5abb in term 0.
I20260811 07:29:50.267938 26773 leader_election.cc:302] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d896caeab2bc4e77bad469fbfa9f5abb, f2e5d7a0383a438f8d22afcb3fc0c308; no voters:
I20260811 07:29:50.268126 27086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:50.249049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:38299 (local address 127.11.248.1:43345)
0811 07:29:50.249181 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:50.249186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:50.257967 (+ 8781us) server_negotiation.cc:407] Connection header received
0811 07:29:50.260779 (+ 2812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:50.260782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:50.260855 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:50.260900 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:50.261393 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.262101 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.266368 (+ 4267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.267096 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.267215 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:50.267292 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:50.267889 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 07:29:50.268007 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 07:29:50.268371 27098 raft_consensus.cc:2781] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:29:50.268474 27098 raft_consensus.cc:482] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:29:50.268527 27098 raft_consensus.cc:3037] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:50.270565 27098 raft_consensus.cc:504] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:50.270987 27098 leader_election.cc:288] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [CANDIDATE]: Term 1 election: Requested vote from peers 8f68dafb3dbb414aa46b66e9ffa38ae1 (127.11.248.1:43345), f2e5d7a0383a438f8d22afcb3fc0c308 (127.11.248.3:40535)
I20260811 07:29:50.271530 27103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:50.250215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:43345 (local address 127.11.248.2:38299)
0811 07:29:50.257853 (+ 7638us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:50.257867 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:50.260635 (+ 2768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:50.261024 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:50.261027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:50.261042 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:50.261260 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:50.261266 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.262312 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.262315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:50.263722 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:50.263732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.267462 (+ 3730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.267465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:50.267649 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:50.267674 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:29:50.271282 (+ 3608us) client_negotiation.cc:240] Negotiation successful
0811 07:29:50.271389 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7571,"thread_start_us":135,"threads_started":1}
I20260811 07:29:50.271587 26977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac43775bb1944518d7c747f66530095" candidate_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308"
I20260811 07:29:50.271739 26977 raft_consensus.cc:3037] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:50.273794 26977 raft_consensus.cc:2454] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d896caeab2bc4e77bad469fbfa9f5abb in term 1.
I20260811 07:29:50.275048 26693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac43775bb1944518d7c747f66530095" candidate_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" is_pre_election: true
I20260811 07:29:50.275389 26693 raft_consensus.cc:2454] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d896caeab2bc4e77bad469fbfa9f5abb in term 0.
I20260811 07:29:50.275725 26692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac43775bb1944518d7c747f66530095" candidate_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1"
I20260811 07:29:50.275853 26692 raft_consensus.cc:3037] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:50.277458 26692 raft_consensus.cc:2454] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d896caeab2bc4e77bad469fbfa9f5abb in term 1.
I20260811 07:29:50.277989 26773 leader_election.cc:302] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d896caeab2bc4e77bad469fbfa9f5abb, f2e5d7a0383a438f8d22afcb3fc0c308; no voters:
I20260811 07:29:50.278205 27098 raft_consensus.cc:2781] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:29:50.278469 27098 raft_consensus.cc:686] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 1 LEADER]: Becoming Leader. State: Replica: d896caeab2bc4e77bad469fbfa9f5abb, State: Running, Role: LEADER
I20260811 07:29:50.279016 27098 consensus_queue.cc:237] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } }
I20260811 07:29:50.283047 26504 catalog_manager.cc:5495] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb reported cstate change: term changed from 0 to 1, leader changed from <none> to d896caeab2bc4e77bad469fbfa9f5abb (127.11.248.2). New cstate: current_term: 1 leader_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d896caeab2bc4e77bad469fbfa9f5abb" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 44851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 } health_report { overall_health: UNKNOWN } } }
I20260811 07:29:50.380780 27090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:50.376143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40766 (local address 127.11.248.2:44851)
0811 07:29:50.376316 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:50.376321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:50.376337 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:29:50.376429 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:50.376432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:50.376504 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:50.376627 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:29:50.376895 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.377655 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.378661 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:50.378994 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:50.379109 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:50.379485 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:29:50.380191 (+ 706us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:29:50.380330 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:50.380402 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:29:50.380469 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:29:50.387714 26977 raft_consensus.cc:1261] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 1 FOLLOWER]: Refusing update from remote peer d896caeab2bc4e77bad469fbfa9f5abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:29:50.387733 26692 raft_consensus.cc:1261] T 3ac43775bb1944518d7c747f66530095 P 8f68dafb3dbb414aa46b66e9ffa38ae1 [term 1 FOLLOWER]: Refusing update from remote peer d896caeab2bc4e77bad469fbfa9f5abb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:29:50.388586 27098 consensus_queue.cc:1035] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2e5d7a0383a438f8d22afcb3fc0c308" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 40535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:29:50.388912 27104 consensus_queue.cc:1035] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f68dafb3dbb414aa46b66e9ffa38ae1" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:29:50.399339 27115 mvcc.cc:205] Tried to move back new op lower bound from 7317231167020130304 to 7317231166586834944. Current Snapshot: MvccSnapshot[applied={T|T < 7317231167020130304}]
I20260811 07:29:50.400870 27117 mvcc.cc:205] Tried to move back new op lower bound from 7317231167020130304 to 7317231166586834944. Current Snapshot: MvccSnapshot[applied={T|T < 7317231167020130304}]
I20260811 07:29:50.411953 26504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:29:50.412246 26504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:29:50.415813 26504 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f318bef79c2429b835deb1290240858: Sending DeleteTablet for 3 replicas of tablet 3ac43775bb1944518d7c747f66530095
I20260811 07:29:50.417011 26667 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ac43775bb1944518d7c747f66530095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:50 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:57162
I20260811 07:29:50.417232 26812 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ac43775bb1944518d7c747f66530095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:50 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:40760
I20260811 07:29:50.417956 26974 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ac43775bb1944518d7c747f66530095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:50 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:59578
I20260811 07:29:50.418118 27126 tablet_replica.cc:330] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: stopping tablet replica
I20260811 07:29:50.418490 27126 raft_consensus.cc:2229] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:29:50.418967 27126 raft_consensus.cc:2258] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:29:50.419891 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26552
I20260811 07:29:50.420722 27126 ts_tablet_manager.cc:1905] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:29:50.425240 27126 ts_tablet_manager.cc:1918] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:29:50.425398 27126 log.cc:1196] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/3ac43775bb1944518d7c747f66530095
I20260811 07:29:50.425865 27126 ts_tablet_manager.cc:1939] T 3ac43775bb1944518d7c747f66530095 P d896caeab2bc4e77bad469fbfa9f5abb: Deleting consensus metadata
I20260811 07:29:50.425900 27127 tablet_replica.cc:330] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: stopping tablet replica
I20260811 07:29:50.426530 27127 raft_consensus.cc:2229] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:29:50.426996 27127 raft_consensus.cc:2258] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:29:50.427734 26491 catalog_manager.cc:4841] TS d896caeab2bc4e77bad469fbfa9f5abb (127.11.248.2:44851): tablet 3ac43775bb1944518d7c747f66530095 (table test-table [id=d16d7cfbc3b748a09f8ba4ce1761da90]) successfully deleted
I20260811 07:29:50.430351 27127 ts_tablet_manager.cc:1905] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:29:50.433766 27127 ts_tablet_manager.cc:1918] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:29:50.433914 27127 log.cc:1196] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/3ac43775bb1944518d7c747f66530095
I20260811 07:29:50.434294 27127 ts_tablet_manager.cc:1939] T 3ac43775bb1944518d7c747f66530095 P f2e5d7a0383a438f8d22afcb3fc0c308: Deleting consensus metadata
I20260811 07:29:50.435914 26492 catalog_manager.cc:4841] TS f2e5d7a0383a438f8d22afcb3fc0c308 (127.11.248.3:40535): tablet 3ac43775bb1944518d7c747f66530095 (table test-table [id=d16d7cfbc3b748a09f8ba4ce1761da90]) successfully deleted
W20260811 07:29:50.437719 26491 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:43345 (error 108)
I20260811 07:29:50.438854 27085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:50.438531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:43345 (local address 127.0.0.1:57172)
0811 07:29:50.438678 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:50.438756 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:43345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:29:50.438948 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26750
W20260811 07:29:50.445467 26491 catalog_manager.cc:4584] TS 8f68dafb3dbb414aa46b66e9ffa38ae1 (127.11.248.1:43345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3ac43775bb1944518d7c747f66530095: Network error: Client connection negotiation failed: client connection to 127.11.248.1:43345: connect: Connection refused (error 111)
I20260811 07:29:50.455402 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26901
I20260811 07:29:50.465350 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 26471
I20260811 07:29:50.477146 12256 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:29:50.823494 12256 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:29:50.823642 12256 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:29:51.179502 12256 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:29:51.179 UTC [25427] LOG: received smart shutdown request
2026-08-11 07:29:51.185 UTC [25427] LOG: background worker "logical replication launcher" (PID 25436) exited with exit code 1
2026-08-11 07:29:51.185 UTC [25431] LOG: shutting down
2026-08-11 07:29:51.393 UTC [25427] LOG: database system is shut down
2026-08-11T07:29:51Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54227 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:29:51 dist-test-slave-77v9 krb5kdc[27139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:29:51 dist-test-slave-77v9 krb5kdc[27139](info): set up 2 sockets
Aug 11 07:29:51 dist-test-slave-77v9 krb5kdc[27139](info): commencing operation
krb5kdc: starting...
W20260811 07:29:52.671649 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:29:52 dist-test-slave-77v9 krb5kdc[27139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:29:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:29:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:29:52.821099 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34905
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:34905,127.11.248.61:35475,127.11.248.60:42349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:52.939775 27153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:52.940177 27153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:52.940265 27153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:52.944934 27153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:52.945060 27153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:52.945096 27153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:52.945140 27153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:52.945175 27153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:52.950950 27153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:34905,127.11.248.61:35475,127.11.248.60:42349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:52.952263 27153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:52.953445 27153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:29:52.963053 27153 server_base.cc:1034] running on GCE node
W20260811 07:29:52.963126 27162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:52.963126 27161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:52.963122 27165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:52.964068 27153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:52.965301 27153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:52.966499 27153 hybrid_clock.cc:648] HybridClock initialized: now 1786433392966475 us; error 40 us; skew 500 ppm
Aug 11 07:29:52 dist-test-slave-77v9 krb5kdc[27139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:52.969956 27153 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:29:52.971009 27153 webserver.cc:460] Webserver started at http://127.11.248.62:45351/ using document root <none> and password file <none>
I20260811 07:29:52.971606 27153 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:52.971704 27153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:52.971959 27153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:52.974210 27153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "f82fa0a628af4590a9c19dc0af58e075"
format_stamp: "Formatted at 2026-08-11 07:29:52 on dist-test-slave-77v9"
server_key: "23d43a95d5820060cd89bebef005da74"
server_key_iv: "6fa20cb85d7af72972be8bcd384405c7"
server_key_version: "encryptionkey@0"
I20260811 07:29:52.974821 27153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "f82fa0a628af4590a9c19dc0af58e075"
format_stamp: "Formatted at 2026-08-11 07:29:52 on dist-test-slave-77v9"
server_key: "23d43a95d5820060cd89bebef005da74"
server_key_iv: "6fa20cb85d7af72972be8bcd384405c7"
server_key_version: "encryptionkey@0"
I20260811 07:29:52.978948 27153 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 07:29:52.981606 27174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:52.982982 27153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:29:52.983148 27153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "f82fa0a628af4590a9c19dc0af58e075"
format_stamp: "Formatted at 2026-08-11 07:29:52 on dist-test-slave-77v9"
server_key: "23d43a95d5820060cd89bebef005da74"
server_key_iv: "6fa20cb85d7af72972be8bcd384405c7"
server_key_version: "encryptionkey@0"
I20260811 07:29:52.983276 27153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:53.010044 27153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:53.013772 27153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:53.014019 27153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:53.022125 27153 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:34905
I20260811 07:29:53.022149 27230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:34905 every 8 connection(s)
I20260811 07:29:53.023155 27153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:29:53.026250 27232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:53.030289 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27153
I20260811 07:29:53.030474 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:29:53.030797 12256 external_mini_cluster.cc:1428] Setting key 09fe10bfffa82a4ae7a39494da2ff05e
I20260811 07:29:53.031072 27232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.248.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.61@KRBTEST.COM" created.
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:53.050863 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.034460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34905 (local address 127.0.0.1:56234)
0811 07:29:53.035117 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.035158 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.036157 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.037026 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.037032 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.037564 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.037852 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.037876 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.039205 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.039209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.040069 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.040080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.040929 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.040933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.041057 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.041754 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.041773 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.044599 (+ 2826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.047258 (+ 2659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.047274 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.047289 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.047663 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.048089 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.048094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.048099 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.048268 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.049068 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.049078 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.049296 (+ 218us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.049518 (+ 222us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.050056 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":106,"spinlock_wait_cycles":3968,"thread_start_us":184,"threads_started":1}
I20260811 07:29:53.050906 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.034436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.11.248.62:34905)
0811 07:29:53.034954 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.034976 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.035296 (+ 320us) server_negotiation.cc:407] Connection header received
0811 07:29:53.036530 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.036536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.036744 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.037023 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.038034 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.039032 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.040210 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.040717 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.040942 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.044845 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.044858 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.044878 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.044918 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.047096 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.047839 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.047846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.047847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.047971 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.048380 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.048383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.048384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.048945 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.049059 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.049676 (+ 617us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.049913 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":175,"threads_started":1}
I20260811 07:29:53.053419 27232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.054301 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.054014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51878)
0811 07:29:53.054154 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.054230 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:29:53.054520 27177 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
I20260811 07:29:53.055445 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.055216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51884)
0811 07:29:53.055334 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.055390 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 07:29:53.055600 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:35475: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab.
Entry for principal kudu/127.11.248.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab.
I20260811 07:29:53.064543 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:35475
--webserver_interface=127.11.248.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab
--principal=kudu/127.11.248.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:34905,127.11.248.61:35475,127.11.248.60:42349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:29:53.104933 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } attempt: 1
I20260811 07:29:53.106019 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.105565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51896)
0811 07:29:53.105838 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.105911 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 07:29:53.107110 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.106765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51912)
0811 07:29:53.106978 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.107036 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260811 07:29:53.107331 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:35475: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
I20260811 07:29:53.175549 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } attempt: 2
I20260811 07:29:53.176553 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.176165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51914)
0811 07:29:53.176365 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.176455 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 07:29:53.177495 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.177207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51918)
0811 07:29:53.177354 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.177425 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:29:53.177680 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:35475: Network error: Client connection negotiation failed: client connection to 127.11.248.61:35475: connect: Connection refused (error 111)
W20260811 07:29:53.181643 27239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:53.181964 27239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:53.182065 27239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:53.186259 27239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:53.186334 27239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:53.186380 27239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:53.186421 27239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:53.186489 27239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:53.192116 27239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:34905,127.11.248.61:35475,127.11.248.60:42349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab
--principal=kudu/127.11.248.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:35475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.248.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:53.193357 27239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:53.194437 27239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:53.203724 27246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:53.203766 27239 server_base.cc:1034] running on GCE node
W20260811 07:29:53.203724 27248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:53.203725 27250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:53.204634 27239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:53.205945 27239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:53.207162 27239 hybrid_clock.cc:648] HybridClock initialized: now 1786433393207147 us; error 33 us; skew 500 ppm
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:53.210780 27239 init.cc:377] Logged in from keytab as kudu/127.11.248.61@KRBTEST.COM (short username kudu)
I20260811 07:29:53.211794 27239 webserver.cc:460] Webserver started at http://127.11.248.61:34265/ using document root <none> and password file <none>
I20260811 07:29:53.212407 27239 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:53.212479 27239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:53.212714 27239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:53.214932 27239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data/instance:
uuid: "57e2a9cb78754808a1c83c4203958779"
format_stamp: "Formatted at 2026-08-11 07:29:53 on dist-test-slave-77v9"
server_key: "6d926b0908a0fdef930fd7e71e052a44"
server_key_iv: "22404bab41b0398b74001cea1749ae9f"
server_key_version: "encryptionkey@0"
I20260811 07:29:53.215560 27239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal/instance:
uuid: "57e2a9cb78754808a1c83c4203958779"
format_stamp: "Formatted at 2026-08-11 07:29:53 on dist-test-slave-77v9"
server_key: "6d926b0908a0fdef930fd7e71e052a44"
server_key_iv: "22404bab41b0398b74001cea1749ae9f"
server_key_version: "encryptionkey@0"
I20260811 07:29:53.219743 27239 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:29:53.222638 27259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:53.224079 27239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:29:53.224241 27239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal
uuid: "57e2a9cb78754808a1c83c4203958779"
format_stamp: "Formatted at 2026-08-11 07:29:53 on dist-test-slave-77v9"
server_key: "6d926b0908a0fdef930fd7e71e052a44"
server_key_iv: "22404bab41b0398b74001cea1749ae9f"
server_key_version: "encryptionkey@0"
I20260811 07:29:53.224387 27239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:53.242334 27239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:53.246325 27239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:53.246579 27239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:53.254361 27239 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.61:35475
I20260811 07:29:53.254390 27321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.61:35475 every 8 connection(s)
I20260811 07:29:53.255367 27239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
I20260811 07:29:53.258484 27323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:53.262998 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27239
I20260811 07:29:53.263137 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-1/wal/instance
I20260811 07:29:53.262915 27323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.263475 12256 external_mini_cluster.cc:1428] Setting key 47b84123228ad7c5b925fdcd342f006e
I20260811 07:29:53.268891 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } attempt: 3
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.60@KRBTEST.COM" created.
I20260811 07:29:53.281795 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.269431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51934)
0811 07:29:53.269612 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.269626 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.269705 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.270491 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.270498 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.270724 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.271004 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.271019 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.272400 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.272403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.273454 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.273469 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.274438 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.274442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.274566 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.275103 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.275120 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.276942 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.279610 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.279614 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.279616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.279936 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.280397 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.280400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.280402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.280489 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.281250 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.281253 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.281346 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.281466 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.281618 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":68}
I20260811 07:29:53.282429 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.266364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.11.248.62:34905)
0811 07:29:53.266526 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.266532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.267883 (+ 1351us) server_negotiation.cc:407] Connection header received
0811 07:29:53.269058 (+ 1175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.269062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.269125 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.269240 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.270792 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.271575 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.273092 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.273438 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.273569 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.276687 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.276692 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.276694 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.276721 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.279409 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.280131 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.280135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.280136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.280227 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.280688 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.280691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.280693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.280939 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.281039 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.281595 (+ 556us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.281759 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":53}
I20260811 07:29:53.283041 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.269608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51934 (local address 127.11.248.61:35475)
0811 07:29:53.270010 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.270025 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.270049 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:29:53.270089 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.270094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.270291 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.270452 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.271171 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.272249 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.273620 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.274274 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.274816 (+ 542us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.277111 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.277116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.277126 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.277146 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.279462 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.280095 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.280105 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.280107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.280250 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.280583 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.280587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.280589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.281144 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.281285 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.281570 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.281873 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":307,"thread_start_us":202,"threads_started":1}
I20260811 07:29:53.283236 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.265976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34905 (local address 127.0.0.1:56246)
0811 07:29:53.267704 (+ 1728us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.267765 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.268765 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.269414 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.269423 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.269984 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.270641 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.270655 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.271713 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.271719 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.272954 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.272965 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.273613 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.273617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.273857 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.274536 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.274554 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.276454 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.279582 (+ 3128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.279594 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.279605 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.280012 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.280347 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.280351 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.280353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.280522 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.281062 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.281073 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.281271 (+ 198us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.281847 (+ 576us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.282082 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1480,"mutex_wait_us":3,"thread_start_us":166,"threads_started":1}
I20260811 07:29:53.285243 27232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.285497 27323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.286128 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.285847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33698)
0811 07:29:53.286001 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.286061 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 07:29:53.286891 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.286629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33714)
0811 07:29:53.286795 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.286845 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:29:53.287120 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:29:53.299729 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.286048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51938)
0811 07:29:53.286192 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.286210 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.286303 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.287125 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.287130 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.287340 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.287441 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.287446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.288689 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.288692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.289526 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.289536 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.290257 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.290260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.290341 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.290955 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.290969 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.294452 (+ 3483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.296469 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.296476 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.296482 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.296771 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.298050 (+ 1279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.298055 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.298057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.298261 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.299012 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.299016 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.299114 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.299214 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.299473 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 07:29:53.299762 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.286259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51938 (local address 127.11.248.61:35475)
0811 07:29:53.286489 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.286493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.286507 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:29:53.286540 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.286543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.286585 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.286664 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.287568 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.288570 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.289653 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.290099 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.290223 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.294641 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.294645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.294647 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.294672 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.296300 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.297018 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.297021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.297023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.297791 (+ 768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.298589 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.298593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.298595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.298838 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.298937 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.299321 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.299579 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":136}
I20260811 07:29:53.300908 27323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab.
Entry for principal kudu/127.11.248.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab.
I20260811 07:29:53.301887 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.301484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33728)
0811 07:29:53.301651 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.301771 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 07:29:53.302562 27263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
I20260811 07:29:53.302919 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:42349
--webserver_interface=127.11.248.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab
--principal=kudu/127.11.248.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:46855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:34905,127.11.248.61:35475,127.11.248.60:42349
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:29:53.303613 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.303366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33740)
0811 07:29:53.303500 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.303552 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 07:29:53.303800 27323 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
I20260811 07:29:53.318344 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 1
I20260811 07:29:53.319380 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.318994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33756)
0811 07:29:53.319211 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.319289 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 07:29:53.320240 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.319994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33772)
0811 07:29:53.320113 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.320166 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:29:53.320441 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
I20260811 07:29:53.353073 27323 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 1
I20260811 07:29:53.356488 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.356010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33774)
0811 07:29:53.356263 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.356371 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260811 07:29:53.357434 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.357180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33782)
0811 07:29:53.357296 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.357349 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 07:29:53.357618 27323 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
I20260811 07:29:53.395671 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 2
I20260811 07:29:53.396710 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.396385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33792)
0811 07:29:53.396560 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.396625 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 07:29:53.397742 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.397446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33804)
0811 07:29:53.397601 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.397665 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 07:29:53.397928 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
I20260811 07:29:53.425832 27323 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 2
I20260811 07:29:53.426926 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.426500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33806)
0811 07:29:53.426732 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.426814 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 07:29:53.427829 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.427537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33812)
0811 07:29:53.427695 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.427757 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:29:53.428052 27323 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
W20260811 07:29:53.427743 27332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:53.428185 27332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:53.428273 27332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:53.434671 27332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:53.434765 27332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:53.434803 27332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:53.434840 27332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:53.434881 27332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:53.440524 27332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:34905,127.11.248.61:35475,127.11.248.60:42349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab
--principal=kudu/127.11.248.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:42349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.248.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:53.441761 27332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:53.442868 27332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:53.452159 27338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:53.452183 27337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:53.452157 27342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:53.452481 27332 server_base.cc:1034] running on GCE node
I20260811 07:29:53.453249 27332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:53.454453 27332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:53.455665 27332 hybrid_clock.cc:648] HybridClock initialized: now 1786433393455619 us; error 65 us; skew 500 ppm
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:53.458703 27332 init.cc:377] Logged in from keytab as kudu/127.11.248.60@KRBTEST.COM (short username kudu)
I20260811 07:29:53.459712 27332 webserver.cc:460] Webserver started at http://127.11.248.60:40017/ using document root <none> and password file <none>
I20260811 07:29:53.460242 27332 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:53.460306 27332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:53.460491 27332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:53.462625 27332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data/instance:
uuid: "bfd944790ab9424a8aa731bf73fa1ff3"
format_stamp: "Formatted at 2026-08-11 07:29:53 on dist-test-slave-77v9"
server_key: "f88635d23a8895ad3f0a3754553d75ec"
server_key_iv: "54bbcda18438817e29837c6425c3a8b5"
server_key_version: "encryptionkey@0"
I20260811 07:29:53.463148 27332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal/instance:
uuid: "bfd944790ab9424a8aa731bf73fa1ff3"
format_stamp: "Formatted at 2026-08-11 07:29:53 on dist-test-slave-77v9"
server_key: "f88635d23a8895ad3f0a3754553d75ec"
server_key_iv: "54bbcda18438817e29837c6425c3a8b5"
server_key_version: "encryptionkey@0"
I20260811 07:29:53.467024 27332 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:29:53.469729 27350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:53.471199 27332 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:29:53.471359 27332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal
uuid: "bfd944790ab9424a8aa731bf73fa1ff3"
format_stamp: "Formatted at 2026-08-11 07:29:53 on dist-test-slave-77v9"
server_key: "f88635d23a8895ad3f0a3754553d75ec"
server_key_iv: "54bbcda18438817e29837c6425c3a8b5"
server_key_version: "encryptionkey@0"
I20260811 07:29:53.471465 27332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:53.492954 27332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:53.496797 27332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:53.497148 27332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:53.497118 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 3
I20260811 07:29:53.497956 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.497624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33814)
0811 07:29:53.497771 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.497831 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:29:53.498833 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.498585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33824)
0811 07:29:53.498709 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.498767 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 07:29:53.499153 27232 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:42349: Network error: Client connection negotiation failed: client connection to 127.11.248.60:42349: connect: Connection refused (error 111)
I20260811 07:29:53.505833 27332 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.60:42349
I20260811 07:29:53.505863 27411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.60:42349 every 8 connection(s)
I20260811 07:29:53.506989 27332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
I20260811 07:29:53.510162 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:53.511958 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27332
I20260811 07:29:53.512079 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433213255187-12256-0/minicluster-data/master-2/wal/instance
I20260811 07:29:53.512398 12256 external_mini_cluster.cc:1428] Setting key d2ac1ff810a2bf8715201d7e7f175fc6
I20260811 07:29:53.514685 27412 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.519248 27323 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 3
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:53.529958 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.519732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33852)
0811 07:29:53.519901 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.519917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.519994 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.520607 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.520611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.520831 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.520938 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.520945 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.521912 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.521918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.522458 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.522468 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.522936 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.522940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.523034 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.523695 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.523706 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.525343 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.528006 (+ 2663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.528009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.528012 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.528224 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.528719 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.528723 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.528725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.528878 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.529454 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.529457 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.529556 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.529659 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.529799 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 07:29:53.530359 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.513997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33836 (local address 127.11.248.60:42349)
0811 07:29:53.514463 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.514480 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.514524 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:29:53.515255 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.515276 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.515661 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.516017 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.517097 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.518661 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.519981 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.520769 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.521070 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.524165 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.524172 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.524186 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.524210 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.526526 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.527138 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.527146 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.527154 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.527304 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.527630 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.527636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.527639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.528374 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.528611 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.528931 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.529254 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":722,"server-negotiator.queue_time_us":302,"thread_start_us":148,"threads_started":1}
I20260811 07:29:53.530773 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.519957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33852 (local address 127.11.248.60:42349)
0811 07:29:53.520355 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.520369 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.520383 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:29:53.520418 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.520421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.520464 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.520558 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.521071 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.521794 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.522579 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.522815 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.522929 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.525487 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.525491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.525494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.525525 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.527890 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.528406 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.528409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.528410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.528513 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.529020 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.529023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.529025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.529318 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.529430 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.529759 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.529887 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":289,"thread_start_us":168,"threads_started":1}
I20260811 07:29:53.530833 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.517601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.11.248.62:34905)
0811 07:29:53.517735 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.517740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.518070 (+ 330us) server_negotiation.cc:407] Connection header received
0811 07:29:53.518235 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.518243 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.518289 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.518392 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.519219 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.520022 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.521197 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.521555 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.521694 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.526380 (+ 4686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.526383 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.526385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.526415 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.528386 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.529033 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.529037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.529038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.529136 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.529549 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.529553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.529555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.529858 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.529960 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.530563 (+ 603us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.530693 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:29:53.530867 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.517499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34905 (local address 127.0.0.1:56250)
0811 07:29:53.517943 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.517985 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.518130 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.518441 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.518446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.518847 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.519027 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.519035 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.520143 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.520149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.521030 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.521042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.522843 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.522853 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.522993 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.523916 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.523942 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.526197 (+ 2255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.528518 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.528528 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.528536 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.528895 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.529266 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.529270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.529273 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.529398 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.530018 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.530026 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.530291 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.530451 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.530652 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":123,"threads_started":1}
I20260811 07:29:53.532428 27412 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.535104 27323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: Bootstrap starting.
I20260811 07:29:53.537889 27323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: Neither blocks nor log segments found. Creating new log.
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:29:53.538882 27323 log.cc:824] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:53.541473 27323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: No bootstrap required, opened a new log
I20260811 07:29:53.543116 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.533094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51940 (local address 127.11.248.61:35475)
0811 07:29:53.533207 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.533211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.533310 (+ 99us) server_negotiation.cc:407] Connection header received
0811 07:29:53.533450 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.533453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.533501 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.533603 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.534188 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.534736 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.535762 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.536068 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.536173 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.539126 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.539132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.539135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.539161 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.541169 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.541684 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.541688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.541690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.541773 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.542125 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.542128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.542130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.542416 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.542537 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.542831 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.542953 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:29:53.543118 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.533036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:35475 (local address 127.0.0.1:51940)
0811 07:29:53.533249 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.533264 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.533353 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.533729 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.533733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.533953 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.534065 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.534071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.534860 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.534867 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.535628 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.535640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.536201 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.536205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.536327 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.537101 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.537114 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.538903 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.541299 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.541306 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.541310 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.541558 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.541887 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.541891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.541893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.541991 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.542529 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.542532 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.542638 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.542758 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.542932 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 07:29:53.543630 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.533258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56254 (local address 127.11.248.62:34905)
0811 07:29:53.533361 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.533376 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.533562 (+ 186us) server_negotiation.cc:407] Connection header received
0811 07:29:53.533667 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.533670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.533722 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.533819 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.534553 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.535240 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.536255 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.536623 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.536744 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.539724 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.539728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.539730 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.539755 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.541593 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.542092 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.542098 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.542100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.542199 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.542570 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.542574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.542575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.542793 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.542971 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.543333 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.543476 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:29:53.544735 27412 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:29:53.545969 27323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.546229 27323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:53.546300 27323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57e2a9cb78754808a1c83c4203958779, State: Initialized, Role: FOLLOWER
I20260811 07:29:53.546844 27323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.547405 27420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.547622 27420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.548280 27323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:29:53.555274 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.545434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33858 (local address 127.11.248.60:42349)
0811 07:29:53.545575 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.545579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.545619 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:29:53.545652 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.545655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.545694 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.546177 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.546254 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.547029 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.547999 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.548296 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.548730 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.551004 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.551009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.551015 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.551051 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.553300 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.553825 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.553828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.553830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.553942 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.554206 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.554209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.554211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.554498 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.554584 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.554949 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.555106 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 07:29:53.555635 27431 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 07:29:53.555764 27416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.545331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33858)
0811 07:29:53.545439 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.545455 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.545541 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.545795 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.545798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.545971 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.546075 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.546081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.547151 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.547156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.547869 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.547881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.548429 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.548433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.548508 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.549094 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.549113 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.550853 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.553410 (+ 2557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.553415 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.553417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.553676 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.554039 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.554043 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.554046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.554122 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.554651 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.554655 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.554765 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.555482 (+ 717us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.555625 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 07:29:53.555768 27431 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:29:53.553138 27239 master_runner.cc:186] Error getting master registration for 127.11.248.62:34905: OK, instance_id { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" instance_seqno: 1786433393019717 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:29:53.556874 27239 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:29:53.559537 27412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: Bootstrap starting.
I20260811 07:29:53.560370 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.545896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51948 (local address 127.11.248.61:35475)
0811 07:29:53.546010 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.546013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.546024 (+ 11us) server_negotiation.cc:407] Connection header received
0811 07:29:53.546053 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.546055 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.546086 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.546181 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.546971 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.547750 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.548649 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.549151 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.549342 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.552631 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.552635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.552639 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.552666 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.558217 (+ 5551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.558772 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.558778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.558780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.558874 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.559198 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.559203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.559205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.559418 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.559660 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.560050 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.560190 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:29:53.562659 27412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:53.563666 27412 log.cc:824] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:53.564193 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:29:53.566300 27412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: No bootstrap required, opened a new log
I20260811 07:29:53.570641 27412 raft_consensus.cc:348] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.571055 27412 raft_consensus.cc:374] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:53.571167 27412 raft_consensus.cc:729] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd944790ab9424a8aa731bf73fa1ff3, State: Initialized, Role: FOLLOWER
I20260811 07:29:53.571817 27412 consensus_queue.cc:260] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.573416 27412 sys_catalog.cc:564] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:29:53.579492 27456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 07:29:53.579664 27235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.566703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56262 (local address 127.11.248.62:34905)
0811 07:29:53.566848 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.566854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.567954 (+ 1100us) server_negotiation.cc:407] Connection header received
0811 07:29:53.568189 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.568197 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.568265 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.568350 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.569652 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.570597 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.571920 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.572316 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.572401 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.574526 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.574530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.574533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.574564 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.576724 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.577910 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.577917 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.577920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.578036 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.578411 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.578416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.578418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.578692 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.578861 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.579304 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.579445 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 07:29:53.580020 27456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:29:53.580228 27443 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.580493 27443 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.577147 27332 master_runner.cc:186] Error getting master registration for 127.11.248.62:34905: OK, instance_id { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" instance_seqno: 1786433393019717 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:29:53.581166 27332 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:29:53.584930 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.567491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51964 (local address 127.11.248.61:35475)
0811 07:29:53.567631 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.567638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.568220 (+ 582us) server_negotiation.cc:407] Connection header received
0811 07:29:53.568513 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.568518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.568568 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.568627 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.573040 (+ 4413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.573948 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.575949 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.576356 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.576493 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.579639 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.579643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.579646 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.579681 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.582008 (+ 2327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.583214 (+ 1206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.583219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.583221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.583332 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.583682 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.583686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.583689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.583960 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.584082 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.584493 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.584637 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:29:53.585197 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.566777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33872 (local address 127.11.248.60:42349)
0811 07:29:53.566904 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.566909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.567983 (+ 1074us) server_negotiation.cc:407] Connection header received
0811 07:29:53.568834 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.568842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.568906 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.568970 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.570870 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.571717 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.575218 (+ 3501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.575659 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.575769 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.580073 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.580079 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.580085 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.580117 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.582773 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.583640 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.583647 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.583652 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.583750 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.584092 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.584099 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.584104 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.584346 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.584474 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.584891 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.585033 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:29:53.663347 27232 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } attempt: 4
Aug 11 07:29:53 dist-test-slave-77v9 krb5kdc[27139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
I20260811 07:29:53.673794 27236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.663840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:42349 (local address 127.0.0.1:33886)
0811 07:29:53.664038 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:53.664054 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:53.664132 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:53.664429 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:53.664432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:53.664670 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:53.664791 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.664798 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.665955 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.665958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.666844 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:53.666855 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.667462 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.667465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:53.667558 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.668174 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:53.668190 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:53.669951 (+ 1761us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:53.672000 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.672004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.672007 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.672284 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.672604 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:53.672607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:53.672609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:53.672720 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:53.673247 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:53.673250 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:53.673353 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 07:29:53.673466 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:29:53.673614 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260811 07:29:53.673866 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:53.663961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33886 (local address 127.11.248.60:42349)
0811 07:29:53.664084 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:53.664089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:53.664106 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:29:53.664236 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:53.664240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:53.664289 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:53.664381 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:53.664950 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.665795 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.666991 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:53.667336 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:53.667446 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:53.670110 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:53.670114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:53.670117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:53.670144 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:53.671867 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.672392 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.672396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.672398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.672496 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:53.672853 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:53.672856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:53.672858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:53.673101 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:53.673197 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:53.673553 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:29:53.673690 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:29:53.677887 27232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: Bootstrap starting.
I20260811 07:29:53.680886 27232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:53.681911 27232 log.cc:824] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:53.684190 27232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: No bootstrap required, opened a new log
I20260811 07:29:53.688344 27232 raft_consensus.cc:348] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.688607 27232 raft_consensus.cc:374] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:53.688669 27232 raft_consensus.cc:729] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82fa0a628af4590a9c19dc0af58e075, State: Initialized, Role: FOLLOWER
I20260811 07:29:53.689193 27232 consensus_queue.cc:260] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.689793 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.690007 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.690677 27232 sys_catalog.cc:564] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 07:29:53.696135 27473 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:29:53.696240 27473 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:29:53.702118 27153 master_runner.cc:263] No leader master found from master f82fa0a628af4590a9c19dc0af58e075
I20260811 07:29:53.702212 27153 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:29:53.733774 27420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:29:53.734014 27420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.735230 27420 leader_election.cc:288] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82fa0a628af4590a9c19dc0af58e075 (127.11.248.62:34905), bfd944790ab9424a8aa731bf73fa1ff3 (127.11.248.60:42349)
I20260811 07:29:53.736259 27380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57e2a9cb78754808a1c83c4203958779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" is_pre_election: true
I20260811 07:29:53.736689 27380 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57e2a9cb78754808a1c83c4203958779 in term 0.
I20260811 07:29:53.737504 27263 leader_election.cc:302] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57e2a9cb78754808a1c83c4203958779, bfd944790ab9424a8aa731bf73fa1ff3; no voters:
I20260811 07:29:53.738617 27202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57e2a9cb78754808a1c83c4203958779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82fa0a628af4590a9c19dc0af58e075" is_pre_election: true
I20260811 07:29:53.739033 27202 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57e2a9cb78754808a1c83c4203958779 in term 0.
I20260811 07:29:53.741568 27420 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:29:53.741693 27420 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:29:53.741739 27420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:53.743211 27420 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.744059 27202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57e2a9cb78754808a1c83c4203958779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82fa0a628af4590a9c19dc0af58e075"
I20260811 07:29:53.744439 27202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:53.745982 27202 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57e2a9cb78754808a1c83c4203958779 in term 1.
I20260811 07:29:53.746919 27264 leader_election.cc:302] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57e2a9cb78754808a1c83c4203958779, f82fa0a628af4590a9c19dc0af58e075; no voters:
I20260811 07:29:53.747602 27420 leader_election.cc:288] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [CANDIDATE]: Term 1 election: Requested vote from peers f82fa0a628af4590a9c19dc0af58e075 (127.11.248.62:34905), bfd944790ab9424a8aa731bf73fa1ff3 (127.11.248.60:42349)
I20260811 07:29:53.748191 27380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57e2a9cb78754808a1c83c4203958779" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd944790ab9424a8aa731bf73fa1ff3"
I20260811 07:29:53.748338 27380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 0 FOLLOWER]: Advancing to term 1
W20260811 07:29:53.748970 27356 tablet.cc:2369] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:29:53.749843 27380 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57e2a9cb78754808a1c83c4203958779 in term 1.
W20260811 07:29:53.750116 27269 tablet.cc:2369] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:29:53.751186 27420 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:29:53.751324 27420 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [term 1 LEADER]: Becoming Leader. State: Replica: 57e2a9cb78754808a1c83c4203958779, State: Running, Role: LEADER
I20260811 07:29:53.751698 27420 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } }
I20260811 07:29:53.753707 27420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e2a9cb78754808a1c83c4203958779. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.753911 27420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:53.754377 27477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:29:53.755350 27477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:29:53.762884 27380 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [term 1 FOLLOWER]: Refusing update from remote peer 57e2a9cb78754808a1c83c4203958779: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:29:53.763912 27475 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:29:53.767176 27180 tablet.cc:2369] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:29:53.772486 27443 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e2a9cb78754808a1c83c4203958779. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.772660 27443 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.774205 27202 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [term 1 FOLLOWER]: Refusing update from remote peer 57e2a9cb78754808a1c83c4203958779: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:29:53.774940 27475 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:29:53.780150 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e2a9cb78754808a1c83c4203958779. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.780345 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.782388 27475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.782563 27475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:53.783018 27443 sys_catalog.cc:455] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.783169 27443 sys_catalog.cc:458] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.784175 27475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.784299 27475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:53.784508 27477 catalog_manager.cc:1347] Generated new cluster ID: 65a2e6093b4e4478961153337c65fa03
I20260811 07:29:53.784555 27477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:29:53.784970 27478 mvcc.cc:205] Tried to move back new op lower bound from 7317231180843864064 to 7317231180810608640. Current Snapshot: MvccSnapshot[applied={T|T < 7317231180843864064 or (T in {7317231180843864064})}]
I20260811 07:29:53.786585 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57e2a9cb78754808a1c83c4203958779" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82fa0a628af4590a9c19dc0af58e075" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34905 } } peers { permanent_uuid: "57e2a9cb78754808a1c83c4203958779" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 35475 } } peers { permanent_uuid: "bfd944790ab9424a8aa731bf73fa1ff3" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 42349 } } }
I20260811 07:29:53.786723 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:29:53.809499 27477 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:29:53.810878 27477 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:29:53.819653 27477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57e2a9cb78754808a1c83c4203958779: Generated new TSK 0
I20260811 07:29:53.820605 27477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:29:54.581831 27456 catalog_manager.cc:1259] Loaded cluster ID: 65a2e6093b4e4478961153337c65fa03
I20260811 07:29:54.581939 27456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: loading cluster ID for follower catalog manager: success
I20260811 07:29:54.583714 27456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: acquiring CA information for follower catalog manager: success
I20260811 07:29:54.584959 27456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bfd944790ab9424a8aa731bf73fa1ff3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:29:54.697738 27473 catalog_manager.cc:1259] Loaded cluster ID: 65a2e6093b4e4478961153337c65fa03
I20260811 07:29:54.697839 27473 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: loading cluster ID for follower catalog manager: success
I20260811 07:29:54.699620 27473 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: acquiring CA information for follower catalog manager: success
I20260811 07:29:54.700898 27473 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f82fa0a628af4590a9c19dc0af58e075: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:29:54.892578 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27153
I20260811 07:29:54.902101 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27239
I20260811 07:29:54.911387 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27332
2026-08-11T07:29:54Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3367 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:29:54 dist-test-slave-77v9 krb5kdc[27494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:29:54 dist-test-slave-77v9 krb5kdc[27494](info): set up 2 sockets
Aug 11 07:29:54 dist-test-slave-77v9 krb5kdc[27494](info): commencing operation
krb5kdc: starting...
W20260811 07:29:56.134610 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:29:56 dist-test-slave-77v9 krb5kdc[27494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:29:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:29:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:29:56.276473 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44797
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:41173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:44797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:56.391323 27507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:56.391702 27507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:56.391793 27507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:56.396059 27507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:56.396183 27507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:56.396219 27507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:56.396263 27507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:56.396296 27507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:56.402222 27507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:41173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:44797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:56.403496 27507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:56.404639 27507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:56.414682 27514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:56.414664 27507 server_base.cc:1034] running on GCE node
W20260811 07:29:56.414661 27515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:56.414695 27517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:56.415640 27507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:56.416895 27507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:56.418095 27507 hybrid_clock.cc:648] HybridClock initialized: now 1786433396418068 us; error 46 us; skew 500 ppm
Aug 11 07:29:56 dist-test-slave-77v9 krb5kdc[27494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433396, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:56.421180 27507 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:29:56.422171 27507 webserver.cc:460] Webserver started at http://127.11.248.62:40377/ using document root <none> and password file <none>
I20260811 07:29:56.422732 27507 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:56.422796 27507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:56.422979 27507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:56.425213 27507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "577f38b91c044245a220eec04caf2705"
format_stamp: "Formatted at 2026-08-11 07:29:56 on dist-test-slave-77v9"
server_key: "5c781a1dba91092f9fc45afc58469dd2"
server_key_iv: "51c5a1566b02f745ce070fff24ade851"
server_key_version: "encryptionkey@0"
I20260811 07:29:56.425781 27507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "577f38b91c044245a220eec04caf2705"
format_stamp: "Formatted at 2026-08-11 07:29:56 on dist-test-slave-77v9"
server_key: "5c781a1dba91092f9fc45afc58469dd2"
server_key_iv: "51c5a1566b02f745ce070fff24ade851"
server_key_version: "encryptionkey@0"
I20260811 07:29:56.429940 27507 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:29:56.432547 27527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:56.433984 27507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:56.434127 27507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "577f38b91c044245a220eec04caf2705"
format_stamp: "Formatted at 2026-08-11 07:29:56 on dist-test-slave-77v9"
server_key: "5c781a1dba91092f9fc45afc58469dd2"
server_key_iv: "51c5a1566b02f745ce070fff24ade851"
server_key_version: "encryptionkey@0"
I20260811 07:29:56.434255 27507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:56.447597 27507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:56.451769 27507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:56.451994 27507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:56.459981 27507 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:44797
I20260811 07:29:56.460016 27588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:44797 every 8 connection(s)
I20260811 07:29:56.461170 27507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:29:56.464500 27589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:56.465013 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27507
I20260811 07:29:56.465166 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:29:56.465488 12256 external_mini_cluster.cc:1428] Setting key 7652303790bb2305b5ee70d6726cb7f8
I20260811 07:29:56.473788 27589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705: Bootstrap starting.
Aug 11 07:29:56 dist-test-slave-77v9 krb5kdc[27494](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:56.476667 27589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:56.477692 27589 log.cc:824] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:56.480669 27589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705: No bootstrap required, opened a new log
I20260811 07:29:56.483840 27593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:56.467010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45510 (local address 127.11.248.62:44797)
0811 07:29:56.467544 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:56.467566 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:56.467616 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:29:56.468692 (+ 1076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:56.468720 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:56.469245 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:56.469690 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:56.470602 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:56.472337 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:56.473473 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:56.474227 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:56.474438 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:56.477394 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:56.477402 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:56.477422 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:56.477466 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:56.479950 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:56.480451 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:56.480458 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:56.480465 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:56.480621 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:56.481048 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:56.481052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:56.481054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:56.481663 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:56.481884 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:56.482274 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 07:29:56.482630 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":160,"threads_started":1}
I20260811 07:29:56.485929 27589 raft_consensus.cc:348] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f38b91c044245a220eec04caf2705" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44797 } }
I20260811 07:29:56.486280 27589 raft_consensus.cc:374] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:56.486405 27589 raft_consensus.cc:729] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 577f38b91c044245a220eec04caf2705, State: Initialized, Role: FOLLOWER
I20260811 07:29:56.486943 27589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f38b91c044245a220eec04caf2705" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44797 } }
I20260811 07:29:56.487169 27589 raft_consensus.cc:388] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:29:56.487243 27589 raft_consensus.cc:482] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:29:56.487365 27589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:56.487596 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:29:56.488932 27589 raft_consensus.cc:504] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f38b91c044245a220eec04caf2705" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44797 } }
I20260811 07:29:56.489329 27589 leader_election.cc:302] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 577f38b91c044245a220eec04caf2705; no voters:
I20260811 07:29:56.489771 27589 leader_election.cc:288] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:29:56.490016 27596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:29:56.490300 27596 raft_consensus.cc:686] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [term 1 LEADER]: Becoming Leader. State: Replica: 577f38b91c044245a220eec04caf2705, State: Running, Role: LEADER
I20260811 07:29:56.490638 27596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f38b91c044245a220eec04caf2705" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44797 } }
I20260811 07:29:56.491255 27589 sys_catalog.cc:564] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:29:56.492558 27598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 577f38b91c044245a220eec04caf2705. Latest consensus state: current_term: 1 leader_uuid: "577f38b91c044245a220eec04caf2705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f38b91c044245a220eec04caf2705" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44797 } } }
I20260811 07:29:56.492726 27598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:56.493081 27597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "577f38b91c044245a220eec04caf2705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f38b91c044245a220eec04caf2705" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44797 } } }
I20260811 07:29:56.493229 27597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705 [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:56.494102 27606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:29:56.497233 27606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:29:56.503945 27606 catalog_manager.cc:1347] Generated new cluster ID: a9790ba1d608431bbdab80090e5183f6
I20260811 07:29:56.504065 27606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:29:56.516366 27606 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:29:56.517493 27606 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:29:56.529920 27606 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 577f38b91c044245a220eec04caf2705: Generated new TSK 0
I20260811 07:29:56.530838 27606 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:29:56.545130 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27507
2026-08-11T07:29:56Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1633 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:29:56 dist-test-slave-77v9 krb5kdc[27621](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:29:56 dist-test-slave-77v9 krb5kdc[27621](info): set up 2 sockets
Aug 11 07:29:56 dist-test-slave-77v9 krb5kdc[27621](info): commencing operation
krb5kdc: starting...
W20260811 07:29:57.876327 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:29:57 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:29:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:29:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:29:58.021944 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42559
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:42559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:58.157454 27635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:58.157811 27635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:58.157918 27635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:58.162730 27635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:58.162829 27635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:58.162855 27635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:58.162878 27635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:58.162953 27635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:58.169380 27635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:42559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:58.170836 27635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:58.171998 27635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:58.181597 27640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:58.181656 27643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:58.181617 27641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:58.181938 27635 server_base.cc:1034] running on GCE node
I20260811 07:29:58.182657 27635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:58.183930 27635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:58.185138 27635 hybrid_clock.cc:648] HybridClock initialized: now 1786433398185112 us; error 43 us; skew 500 ppm
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:58.194000 27635 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:29:58.195170 27635 webserver.cc:460] Webserver started at http://127.11.248.62:43973/ using document root <none> and password file <none>
I20260811 07:29:58.195837 27635 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:58.195950 27635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:58.196224 27635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:58.198702 27635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "83dd90d3e81f4bfb84dd57c3deb538af"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "6037e024b5ce60e5857b153b485ca808"
server_key_iv: "738808a85a473f7a6d7ed8282c114715"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.199371 27635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "83dd90d3e81f4bfb84dd57c3deb538af"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "6037e024b5ce60e5857b153b485ca808"
server_key_iv: "738808a85a473f7a6d7ed8282c114715"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.203866 27635 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:29:58.206737 27651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.208140 27635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:58.208339 27635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "83dd90d3e81f4bfb84dd57c3deb538af"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "6037e024b5ce60e5857b153b485ca808"
server_key_iv: "738808a85a473f7a6d7ed8282c114715"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.208488 27635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:58.226917 27635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:58.230834 27635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:58.231119 27635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:58.240415 27635 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:42559
I20260811 07:29:58.240760 27714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:42559 every 8 connection(s)
I20260811 07:29:58.241770 27635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:29:58.242125 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27635
I20260811 07:29:58.242311 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:29:58.242692 12256 external_mini_cluster.cc:1428] Setting key 4a1dca0e9fe44acfaf513f1162768222
I20260811 07:29:58.245198 27715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:58.250892 27715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap starting.
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:58.253464 27715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:58.254302 27715 log.cc:824] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:58.256767 27715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: No bootstrap required, opened a new log
I20260811 07:29:58.259685 27718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:58.244333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54408 (local address 127.11.248.62:42559)
0811 07:29:58.244984 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:58.245005 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:58.245057 (+ 52us) server_negotiation.cc:407] Connection header received
0811 07:29:58.245877 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:58.245896 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:58.246256 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:58.246664 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:58.247687 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.248911 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.249923 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.250461 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.250667 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:58.253907 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:58.253912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:58.253926 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:58.253956 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:58.256093 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:58.256695 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:58.256701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:58.256707 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:58.256896 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:58.257230 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:58.257234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:58.257236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:58.257761 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:58.257971 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:58.258280 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 07:29:58.258601 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":143,"threads_started":1}
I20260811 07:29:58.261480 27715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:58.261741 27715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:58.261829 27715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83dd90d3e81f4bfb84dd57c3deb538af, State: Initialized, Role: FOLLOWER
I20260811 07:29:58.262255 27715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:58.262416 27715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:29:58.262512 27715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:29:58.262617 27715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:58.263659 27715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:58.264039 27715 leader_election.cc:302] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83dd90d3e81f4bfb84dd57c3deb538af; no voters:
I20260811 07:29:58.264390 27715 leader_election.cc:288] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:29:58.264554 27721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:29:58.264863 27721 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 LEADER]: Becoming Leader. State: Replica: 83dd90d3e81f4bfb84dd57c3deb538af, State: Running, Role: LEADER
I20260811 07:29:58.265202 27721 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:58.265859 27715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:29:58.267263 27722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83dd90d3e81f4bfb84dd57c3deb538af. Latest consensus state: current_term: 1 leader_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } } }
I20260811 07:29:58.267261 27723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } } }
I20260811 07:29:58.267457 27722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:58.267457 27723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:58.268429 27733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:29:58.271579 27733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:29:58.278029 27733 catalog_manager.cc:1347] Generated new cluster ID: 31ded244de85405595c2f722fda8af6a
I20260811 07:29:58.278139 27733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:29:58.294435 27733 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:29:58.295691 27733 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:29:58.303124 27733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Generated new TSK 0
I20260811 07:29:58.304040 27733 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:29:58.350148 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:42559
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:58.479552 27745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:58.479857 27745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:58.479903 27745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:58.484037 27745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:58.484158 27745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:58.484263 27745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:29:58.489821 27745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:58.490985 27745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:58.492086 27745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:58.502303 27754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:58.502489 27745 server_base.cc:1034] running on GCE node
W20260811 07:29:58.502269 27751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:58.502267 27752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:58.503043 27745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:58.503803 27745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:58.505007 27745 hybrid_clock.cc:648] HybridClock initialized: now 1786433398504975 us; error 52 us; skew 500 ppm
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:58.508031 27745 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:29:58.509035 27745 webserver.cc:460] Webserver started at http://127.11.248.1:37911/ using document root <none> and password file <none>
I20260811 07:29:58.509598 27745 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:58.509660 27745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:58.509828 27745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:58.511916 27745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "ed108755da3d4fc283ad3792bd98fd38"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "bfc740d88e24d500da4e6b13d36ecb52"
server_key_iv: "6c1f928c274cf5d76cc01147e71d5b12"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.512542 27745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "ed108755da3d4fc283ad3792bd98fd38"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "bfc740d88e24d500da4e6b13d36ecb52"
server_key_iv: "6c1f928c274cf5d76cc01147e71d5b12"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.516513 27745 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 07:29:58.519248 27763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.520668 27745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:58.520812 27745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "ed108755da3d4fc283ad3792bd98fd38"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "bfc740d88e24d500da4e6b13d36ecb52"
server_key_iv: "6c1f928c274cf5d76cc01147e71d5b12"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.520967 27745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:58.533963 27745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:58.537480 27745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:58.537698 27745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:58.538331 27745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:58.539202 27745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:58.539263 27745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.539336 27745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:58.539378 27745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.549086 27745 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:34693
I20260811 07:29:58.549114 27894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:34693 every 8 connection(s)
I20260811 07:29:58.550032 27745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:58.560281 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27745
I20260811 07:29:58.560467 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:29:58.560798 12256 external_mini_cluster.cc:1428] Setting key 95ed6af2a40eff2af0644139f944e178
I20260811 07:29:58.564940 27718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:58.551872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:47885 (local address 127.11.248.62:42559)
0811 07:29:58.552018 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:58.552021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:58.552872 (+ 851us) server_negotiation.cc:407] Connection header received
0811 07:29:58.554267 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:58.554271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:58.554335 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:58.554447 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:58.555632 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.556182 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.557491 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.557725 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.557785 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:58.560485 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:58.560488 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:58.560490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:58.560515 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:58.562389 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:58.562946 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:58.562952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:58.562954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:58.563061 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:58.563457 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:58.563464 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:58.563469 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:58.563758 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:58.563881 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:58.564483 (+ 602us) server_negotiation.cc:299] Negotiation successful
0811 07:29:58.564655 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:29:58.566071 27898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:58.552201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:47885)
0811 07:29:58.552680 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:58.552724 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:58.554049 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:58.554631 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:58.554637 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:58.555012 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:58.555484 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:58.555497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.556309 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.556313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:58.557327 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:58.557339 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.557968 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.557970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:58.558113 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:58.558692 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:58.558709 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:58.560292 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:58.562539 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:58.562543 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:58.562556 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:58.562822 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:58.563171 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:58.563174 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:58.563175 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:58.563351 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:58.563904 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:58.563910 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:58.564182 (+ 272us) client_negotiation.cc:769] Sending connection context
0811 07:29:58.564401 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 07:29:58.564709 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":122,"threads_started":1}
I20260811 07:29:58.567615 27896 heartbeater.cc:347] Connected to a master server at 127.11.248.62:42559
I20260811 07:29:58.567894 27896 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:58.568496 27896 heartbeater.cc:511] Master 127.11.248.62:42559 requested a full tablet report, sending...
I20260811 07:29:58.570299 27669 ts_manager.cc:194] Registered new tserver with Master: ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:29:58.571593 27669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:47885
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:29:58.596375 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:42559
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:58.714558 27901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:58.714869 27901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:58.714990 27901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:58.719141 27901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:58.719238 27901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:58.719329 27901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:29:58.724917 27901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:58.726087 27901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:58.727152 27901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:58.737145 27911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:58.737161 27907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:58.737143 27906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:58.737376 27901 server_base.cc:1034] running on GCE node
I20260811 07:29:58.737986 27901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:58.738693 27901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:58.739895 27901 hybrid_clock.cc:648] HybridClock initialized: now 1786433398739887 us; error 46 us; skew 500 ppm
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:58.742780 27901 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:29:58.743837 27901 webserver.cc:460] Webserver started at http://127.11.248.2:37419/ using document root <none> and password file <none>
I20260811 07:29:58.744417 27901 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:58.744516 27901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:58.744755 27901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:58.747000 27901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "793c952b7c58481797abf762a6880361"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "8a1c2c348e7916f12739e9a3db70d657"
server_key_iv: "bbc1482bcb6b71db326a8cb17adb24b7"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.747632 27901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "793c952b7c58481797abf762a6880361"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "8a1c2c348e7916f12739e9a3db70d657"
server_key_iv: "bbc1482bcb6b71db326a8cb17adb24b7"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.751544 27901 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:29:58.754036 27921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.755221 27901 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:29:58.755362 27901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "793c952b7c58481797abf762a6880361"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "8a1c2c348e7916f12739e9a3db70d657"
server_key_iv: "bbc1482bcb6b71db326a8cb17adb24b7"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.755479 27901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:58.769672 27901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:58.773190 27901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:58.773423 27901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:58.774087 27901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:58.774989 27901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:58.775068 27901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.775141 27901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:58.775185 27901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.785569 27901 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:34087
I20260811 07:29:58.785590 28049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:34087 every 8 connection(s)
I20260811 07:29:58.786609 27901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:29:58.795032 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 27901
I20260811 07:29:58.795186 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:29:58.795454 12256 external_mini_cluster.cc:1428] Setting key a036061ea4533cdb0d13c389f15afc7d
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:58.801936 27718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:58.788563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:55143 (local address 127.11.248.62:42559)
0811 07:29:58.788717 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:58.788721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:58.789715 (+ 994us) server_negotiation.cc:407] Connection header received
0811 07:29:58.791220 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:58.791222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:58.791272 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:58.791379 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:58.792592 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.793191 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.794330 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.794571 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.794652 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:58.797881 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:58.797885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:58.797887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:58.797913 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:58.799571 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:58.800119 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:58.800124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:58.800126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:58.800233 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:58.800599 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:58.800605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:58.800606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:58.800914 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:58.800998 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:58.801526 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 07:29:58.801683 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:29:58.802806 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:58.789037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:55143)
0811 07:29:58.789549 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:58.789595 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:58.791005 (+ 1410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:58.791528 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:58.791535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:58.791930 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:58.792456 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:58.792470 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.793317 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.793320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:58.794213 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:58.794223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:58.794711 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:58.794714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:58.794856 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:58.795619 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:58.795636 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:58.797682 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:58.799707 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:58.799712 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:58.799725 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:58.800011 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:58.800342 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:58.800344 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:58.800346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:58.800502 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:58.801001 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:58.801006 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:58.801269 (+ 263us) client_negotiation.cc:769] Sending connection context
0811 07:29:58.801438 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 07:29:58.801738 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":123,"threads_started":1}
I20260811 07:29:58.804188 28050 heartbeater.cc:347] Connected to a master server at 127.11.248.62:42559
I20260811 07:29:58.804456 28050 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:58.805038 28050 heartbeater.cc:511] Master 127.11.248.62:42559 requested a full tablet report, sending...
I20260811 07:29:58.806223 27669 ts_manager.cc:194] Registered new tserver with Master: 793c952b7c58481797abf762a6880361 (127.11.248.2:34087)
I20260811 07:29:58.806885 27669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:55143
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:29:58.830152 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:42559
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:58.952693 28055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:58.953181 28055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:58.953230 28055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:58.957665 28055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:58.957737 28055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:58.957800 28055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:29:58.963510 28055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:58.964593 28055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:58.965660 28055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:58.976225 28060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:58.976204 28061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:58.976339 28055 server_base.cc:1034] running on GCE node
W20260811 07:29:58.976246 28063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:58.977027 28055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:58.977737 28055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:58.979012 28055 hybrid_clock.cc:648] HybridClock initialized: now 1786433398979001 us; error 38 us; skew 500 ppm
Aug 11 07:29:58 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:58.982206 28055 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:29:58.983217 28055 webserver.cc:460] Webserver started at http://127.11.248.3:42629/ using document root <none> and password file <none>
I20260811 07:29:58.983865 28055 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:58.983974 28055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:58.984221 28055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:29:58.986418 28055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "898e097f4b574b1cafc4eb92bf41d3fe"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "fce8c9df186a458bcef7f895030e6d9e"
server_key_iv: "9d40d60eb8be7976e206f82d3c0a81b7"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.987067 28055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "898e097f4b574b1cafc4eb92bf41d3fe"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "fce8c9df186a458bcef7f895030e6d9e"
server_key_iv: "9d40d60eb8be7976e206f82d3c0a81b7"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.991123 28055 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:29:58.993721 28070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:58.995036 28055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:29:58.995208 28055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "898e097f4b574b1cafc4eb92bf41d3fe"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "fce8c9df186a458bcef7f895030e6d9e"
server_key_iv: "9d40d60eb8be7976e206f82d3c0a81b7"
server_key_version: "encryptionkey@0"
I20260811 07:29:58.995330 28055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:59.016788 28055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:59.020478 28055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:59.020718 28055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:59.021507 28055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:59.022365 28055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:29:59.022439 28055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:59.022511 28055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:29:59.022565 28055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:59.032436 28055 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:46115
I20260811 07:29:59.032472 28200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:46115 every 8 connection(s)
I20260811 07:29:59.033535 28055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:29:59.039237 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28055
I20260811 07:29:59.039395 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:29:59.039695 12256 external_mini_cluster.cc:1428] Setting key d6c2e3f532406fa1e4ddd2bf292447b4
Aug 11 07:29:59 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:59.049134 27718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.035522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:37373 (local address 127.11.248.62:42559)
0811 07:29:59.035674 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.035678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.036502 (+ 824us) server_negotiation.cc:407] Connection header received
0811 07:29:59.037984 (+ 1482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.037987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.038054 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.038162 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:59.039545 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.040211 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.041937 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.042298 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.042398 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.045226 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:59.045230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:59.045232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:59.045276 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:59.046931 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:59.047466 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:59.047469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:59.047470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:59.047554 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:59.047924 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:59.047926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:59.047927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:59.048118 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:59.048196 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.048790 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.048992 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:29:59.050031 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.035838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:37373)
0811 07:29:59.036327 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.036373 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.037748 (+ 1375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.038360 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.038367 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.038833 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:59.039352 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.039365 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.040398 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.040402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.041797 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.041807 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.042573 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.042577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.042732 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.043379 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:59.043395 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:59.045034 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:59.047053 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:59.047058 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:59.047072 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:59.047354 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:59.047637 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:59.047639 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:59.047640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:59.047783 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:59.048221 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:59.048227 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:59.048510 (+ 283us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.048676 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.049055 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":118,"threads_started":1}
I20260811 07:29:59.051376 28201 heartbeater.cc:347] Connected to a master server at 127.11.248.62:42559
I20260811 07:29:59.051612 28201 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:59.052124 28201 heartbeater.cc:511] Master 127.11.248.62:42559 requested a full tablet report, sending...
I20260811 07:29:59.053454 27668 ts_manager.cc:194] Registered new tserver with Master: 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115)
I20260811 07:29:59.054112 27668 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:37373
I20260811 07:29:59.054306 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:29:59.064769 27718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.056497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56018 (local address 127.11.248.62:42559)
0811 07:29:59.056633 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.056636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.056886 (+ 250us) server_negotiation.cc:407] Connection header received
0811 07:29:59.057003 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.057005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.057045 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.057112 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:59.057866 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.058394 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.059627 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.059839 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.059924 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.061554 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:59.061557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:59.061559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:59.061582 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:59.063136 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:59.063540 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:59.063543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:59.063544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:59.063618 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:59.063890 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:59.063893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:59.063894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:59.064135 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:59.064245 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.064537 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.064640 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:29:59.068476 27668 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:29:59.071681 27668 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:29:59.087886 28214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.081516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:46115 (local address 127.0.0.1:39038)
0811 07:29:59.082422 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.082436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.082579 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.083232 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.083237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.083268 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:59.083414 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.083420 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.084971 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.084974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.086337 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.086348 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.087225 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.087228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.087418 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.087490 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.087607 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.087730 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"mutex_wait_us":76,"thread_start_us":125,"threads_started":1}
I20260811 07:29:59.087894 28215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.081689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39038 (local address 127.11.248.3:46115)
0811 07:29:59.082285 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.082297 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.082718 (+ 421us) server_negotiation.cc:407] Connection header received
0811 07:29:59.082889 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.082893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.083066 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.083239 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:59.083528 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.084772 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.086504 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.087093 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.087222 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.087381 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.087638 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.087733 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":136,"threads_started":1}
I20260811 07:29:59.088707 28212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.081316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34087 (local address 127.0.0.1:47376)
0811 07:29:59.082300 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.082374 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.082579 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.083393 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.083396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.083412 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:59.083527 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.083532 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.084971 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.084974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.086389 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.086400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.088266 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.088270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.088367 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.088392 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.088474 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.088547 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"mutex_wait_us":3,"thread_start_us":72,"threads_started":1}
I20260811 07:29:59.089257 28213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.081509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47376 (local address 127.11.248.2:34087)
0811 07:29:59.082066 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.082080 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.082482 (+ 402us) server_negotiation.cc:407] Connection header received
0811 07:29:59.082771 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.082778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.083018 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.083163 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:59.083625 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.084784 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.086525 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.087909 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.088052 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.088202 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.088992 (+ 790us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.089107 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":136,"threads_started":1}
I20260811 07:29:59.089886 28216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.082214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.0.0.1:56698)
0811 07:29:59.083141 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.083154 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.083242 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.083750 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.083753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.083771 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:59.083869 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.083879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.084871 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.084876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.086169 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.086179 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.089477 (+ 3298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.089481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.089583 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.089608 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.089692 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.089763 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"thread_start_us":87,"threads_started":1}
I20260811 07:29:59.090148 28217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.082415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56698 (local address 127.11.248.1:34693)
0811 07:29:59.082792 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.082798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.083342 (+ 544us) server_negotiation.cc:407] Connection header received
0811 07:29:59.083422 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.083428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.083611 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.083773 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:59.084014 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.084729 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.086298 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.087134 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.087358 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.087505 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.089747 (+ 2242us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.089855 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":97,"threads_started":1}
I20260811 07:29:59.091327 28126 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9cccab35c94741849c3f55c7201937 (DEFAULT_TABLE table=test-table [id=c561c0c7c07c46d18cdb382836742389]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:29:59.092250 28126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9cccab35c94741849c3f55c7201937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:59.091893 27974 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9cccab35c94741849c3f55c7201937 (DEFAULT_TABLE table=test-table [id=c561c0c7c07c46d18cdb382836742389]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:29:59.092973 27974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9cccab35c94741849c3f55c7201937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:59.092689 27819 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9cccab35c94741849c3f55c7201937 (DEFAULT_TABLE table=test-table [id=c561c0c7c07c46d18cdb382836742389]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:29:59.093713 27819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9cccab35c94741849c3f55c7201937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:29:59.098084 28218 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Bootstrap starting.
I20260811 07:29:59.100888 28218 tablet_bootstrap.cc:654] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:59.101136 28220 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Bootstrap starting.
I20260811 07:29:59.102035 28221 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Bootstrap starting.
I20260811 07:29:59.102061 28218 log.cc:824] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:59.103420 28220 tablet_bootstrap.cc:654] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:59.104323 28220 log.cc:824] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:59.104446 28218 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: No bootstrap required, opened a new log
I20260811 07:29:59.104533 28221 tablet_bootstrap.cc:654] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Neither blocks nor log segments found. Creating new log.
I20260811 07:29:59.104642 28218 ts_tablet_manager.cc:1397] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 07:29:59.105425 28221 log.cc:824] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:59.106506 28220 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: No bootstrap required, opened a new log
I20260811 07:29:59.106720 28220 ts_tablet_manager.cc:1397] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:29:59.107275 28221 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: No bootstrap required, opened a new log
I20260811 07:29:59.107481 28221 ts_tablet_manager.cc:1397] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:29:59.108867 28218 raft_consensus.cc:348] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.109167 28218 raft_consensus.cc:374] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:59.109238 28218 raft_consensus.cc:729] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898e097f4b574b1cafc4eb92bf41d3fe, State: Initialized, Role: FOLLOWER
I20260811 07:29:59.109724 28218 consensus_queue.cc:260] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.110867 28218 ts_tablet_manager.cc:1428] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 07:29:59.110884 28221 raft_consensus.cc:348] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.111171 28221 raft_consensus.cc:374] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:59.111223 28221 raft_consensus.cc:729] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793c952b7c58481797abf762a6880361, State: Initialized, Role: FOLLOWER
I20260811 07:29:59.111395 28201 heartbeater.cc:503] Master 127.11.248.62:42559 was elected leader, sending a full tablet report...
I20260811 07:29:59.111235 28220 raft_consensus.cc:348] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.111477 28220 raft_consensus.cc:374] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:29:59.111531 28220 raft_consensus.cc:729] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed108755da3d4fc283ad3792bd98fd38, State: Initialized, Role: FOLLOWER
I20260811 07:29:59.111711 28221 consensus_queue.cc:260] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.112056 28220 consensus_queue.cc:260] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.112576 28050 heartbeater.cc:503] Master 127.11.248.62:42559 was elected leader, sending a full tablet report...
I20260811 07:29:59.112859 28221 ts_tablet_manager.cc:1428] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Time spent starting tablet: real 0.005s user 0.002s sys 0.005s
I20260811 07:29:59.113391 28220 ts_tablet_manager.cc:1428] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:29:59.113426 27896 heartbeater.cc:503] Master 127.11.248.62:42559 was elected leader, sending a full tablet report...
W20260811 07:29:59.284811 28202 tablet.cc:2369] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:29:59.288093 28051 tablet.cc:2369] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:29:59.301389 27897 tablet.cc:2369] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:29:59.365599 28225 raft_consensus.cc:482] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:29:59.365921 28225 raft_consensus.cc:504] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.367221 28225 leader_election.cc:288] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 793c952b7c58481797abf762a6880361 (127.11.248.2:34087), ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:29:59.371573 28213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.367694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:33827 (local address 127.11.248.2:34087)
0811 07:29:59.367846 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.367930 (+ 84us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.367950 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:29:59.368168 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.368173 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.368232 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.368311 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:59.368668 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.369508 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.370604 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.371008 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.371145 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.371196 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.371380 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.371452 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:29:59.371573 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.367617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34087 (local address 127.11.248.3:33827)
0811 07:29:59.367802 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.367819 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.367976 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.368445 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.368448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.368464 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:59.368558 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.368562 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.369626 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.369628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.370476 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.370484 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.371134 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.371138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.371250 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.371268 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.371360 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.371436 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":23}
I20260811 07:29:59.371769 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.367950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.11.248.3:33325)
0811 07:29:59.368319 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.368333 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.368449 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.368733 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.368735 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.368746 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:29:59.368880 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.368886 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.369815 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.369819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.370635 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.370644 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.371323 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.371326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.371430 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.371451 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.371549 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.371619 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":23,"thread_start_us":132,"threads_started":1}
I20260811 07:29:59.371754 28217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.368184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:33325 (local address 127.11.248.1:34693)
0811 07:29:59.368322 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.368329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.368400 (+ 71us) server_negotiation.cc:407] Connection header received
0811 07:29:59.368576 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.368579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.368634 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.368718 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:29:59.368990 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.369701 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.370767 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.371195 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.371328 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.371381 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.371567 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.371642 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:29:59.372699 27840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9cccab35c94741849c3f55c7201937" candidate_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed108755da3d4fc283ad3792bd98fd38" is_pre_election: true
I20260811 07:29:59.372740 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9cccab35c94741849c3f55c7201937" candidate_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "793c952b7c58481797abf762a6880361" is_pre_election: true
I20260811 07:29:59.373090 27997 raft_consensus.cc:2454] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898e097f4b574b1cafc4eb92bf41d3fe in term 0.
I20260811 07:29:59.373091 27840 raft_consensus.cc:2454] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 898e097f4b574b1cafc4eb92bf41d3fe in term 0.
I20260811 07:29:59.373596 28074 leader_election.cc:302] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 793c952b7c58481797abf762a6880361, 898e097f4b574b1cafc4eb92bf41d3fe; no voters:
I20260811 07:29:59.373862 28225 raft_consensus.cc:2781] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:29:59.373955 28225 raft_consensus.cc:482] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:29:59.374004 28225 raft_consensus.cc:3037] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:59.375090 28225 raft_consensus.cc:504] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.375450 28225 leader_election.cc:288] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [CANDIDATE]: Term 1 election: Requested vote from peers 793c952b7c58481797abf762a6880361 (127.11.248.2:34087), ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:29:59.375947 27840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9cccab35c94741849c3f55c7201937" candidate_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed108755da3d4fc283ad3792bd98fd38"
I20260811 07:29:59.375963 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9cccab35c94741849c3f55c7201937" candidate_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "793c952b7c58481797abf762a6880361"
I20260811 07:29:59.376093 27997 raft_consensus.cc:3037] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:59.376094 27840 raft_consensus.cc:3037] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:29:59.377521 27997 raft_consensus.cc:2454] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898e097f4b574b1cafc4eb92bf41d3fe in term 1.
I20260811 07:29:59.377521 27840 raft_consensus.cc:2454] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 898e097f4b574b1cafc4eb92bf41d3fe in term 1.
I20260811 07:29:59.377861 28074 leader_election.cc:302] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 898e097f4b574b1cafc4eb92bf41d3fe, ed108755da3d4fc283ad3792bd98fd38; no voters:
I20260811 07:29:59.378052 28225 raft_consensus.cc:2781] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:29:59.378311 28225 raft_consensus.cc:686] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 LEADER]: Becoming Leader. State: Replica: 898e097f4b574b1cafc4eb92bf41d3fe, State: Running, Role: LEADER
I20260811 07:29:59.378734 28225 consensus_queue.cc:237] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.382254 27669 catalog_manager.cc:5495] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3). New cstate: current_term: 1 leader_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } health_report { overall_health: UNKNOWN } } }
I20260811 07:29:59.461963 28215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.458202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.11.248.3:46115)
0811 07:29:59.458336 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.458362 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.458376 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:29:59.458453 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.458455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.458512 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.458630 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:29:59.458843 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.459470 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.460447 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.460655 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.460737 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.461099 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:29:59.461541 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:29:59.461636 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.461702 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.461756 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:29:59.468178 27840 raft_consensus.cc:1261] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Refusing update from remote peer 898e097f4b574b1cafc4eb92bf41d3fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:29:59.468178 27997 raft_consensus.cc:1261] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Refusing update from remote peer 898e097f4b574b1cafc4eb92bf41d3fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:29:59.469033 28225 consensus_queue.cc:1035] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:29:59.469269 28229 consensus_queue.cc:1035] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:29:59.477030 28232 mvcc.cc:205] Tried to move back new op lower bound from 7317231204213432320 to 7317231203858489344. Current Snapshot: MvccSnapshot[applied={T|T < 7317231204213432320}]
I20260811 07:29:59.477201 28235 mvcc.cc:205] Tried to move back new op lower bound from 7317231204213432320 to 7317231203858489344. Current Snapshot: MvccSnapshot[applied={T|T < 7317231204213432320}]
I20260811 07:29:59.486883 27667 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:29:59.487104 27667 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:29:59.489904 27667 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Sending DeleteTablet for 3 replicas of tablet 3c9cccab35c94741849c3f55c7201937
I20260811 07:29:59.490907 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27745
I20260811 07:29:59.490873 27819 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9cccab35c94741849c3f55c7201937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:59 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:56698
I20260811 07:29:59.490921 28126 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9cccab35c94741849c3f55c7201937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:59 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:39038
I20260811 07:29:59.494930 28247 tablet_replica.cc:330] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: stopping tablet replica
I20260811 07:29:59.494870 27974 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9cccab35c94741849c3f55c7201937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:59 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:47376
I20260811 07:29:59.495361 28247 raft_consensus.cc:2229] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:29:59.495594 28248 tablet_replica.cc:330] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: stopping tablet replica
I20260811 07:29:59.495885 28247 raft_consensus.cc:2258] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:29:59.495910 28248 raft_consensus.cc:2229] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:29:59.496246 28248 raft_consensus.cc:2258] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:29:59.497727 28247 ts_tablet_manager.cc:1905] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:29:59.497727 28248 ts_tablet_manager.cc:1905] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:29:59.500638 28247 ts_tablet_manager.cc:1918] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:29:59.500635 28248 ts_tablet_manager.cc:1918] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:29:59.500762 28248 log.cc:1196] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/3c9cccab35c94741849c3f55c7201937
I20260811 07:29:59.500929 28247 log.cc:1196] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/3c9cccab35c94741849c3f55c7201937
I20260811 07:29:59.501157 28248 ts_tablet_manager.cc:1939] T 3c9cccab35c94741849c3f55c7201937 P 793c952b7c58481797abf762a6880361: Deleting consensus metadata
I20260811 07:29:59.501396 28247 ts_tablet_manager.cc:1939] T 3c9cccab35c94741849c3f55c7201937 P 898e097f4b574b1cafc4eb92bf41d3fe: Deleting consensus metadata
I20260811 07:29:59.502576 27653 catalog_manager.cc:4841] TS 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115): tablet 3c9cccab35c94741849c3f55c7201937 (table test-table [id=c561c0c7c07c46d18cdb382836742389]) successfully deleted
W20260811 07:29:59.502630 27655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:34693 (error 108)
I20260811 07:29:59.502640 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27901
I20260811 07:29:59.510094 28216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.509668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.0.0.1:56706)
0811 07:29:59.509867 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.509969 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:34693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 07:29:59.510447 27655 catalog_manager.cc:4584] TS ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3c9cccab35c94741849c3f55c7201937: Network error: Client connection negotiation failed: client connection to 127.11.248.1:34693: connect: Connection refused (error 111)
I20260811 07:29:59.510636 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 28055
I20260811 07:29:59.512272 28216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.510750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34087 (local address 127.0.0.1:47386)
0811 07:29:59.512097 (+ 1347us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.512172 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.2:34087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1254}
I20260811 07:29:59.520144 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 27635
I20260811 07:29:59.529960 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42559
--webserver_interface=127.11.248.62
--webserver_port=43973
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:42559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:29:59.653604 28250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:59.653956 28250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:59.654043 28250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:59.658473 28250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:29:59.658572 28250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:59.658612 28250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:59.658651 28250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:29:59.658686 28250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:29:59.664248 28250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:42559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=43973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:59.665457 28250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:59.666682 28250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:59.682073 28260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:59.682075 28257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:59.682139 28250 server_base.cc:1034] running on GCE node
W20260811 07:29:59.682075 28258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:59.683000 28250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:59.684302 28250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:59.685523 28250 hybrid_clock.cc:648] HybridClock initialized: now 1786433399685508 us; error 39 us; skew 500 ppm
Aug 11 07:29:59 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:59.689095 28250 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:29:59.690306 28250 webserver.cc:460] Webserver started at http://127.11.248.62:43973/ using document root <none> and password file <none>
I20260811 07:29:59.691004 28250 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:59.691148 28250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:59.695915 28250 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260811 07:29:59.698530 28268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:59.699860 28250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:29:59.700042 28250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "83dd90d3e81f4bfb84dd57c3deb538af"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "6037e024b5ce60e5857b153b485ca808"
server_key_iv: "738808a85a473f7a6d7ed8282c114715"
server_key_version: "encryptionkey@0"
I20260811 07:29:59.700722 28250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:59.739718 28250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:59.743250 28250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:59.743507 28250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:59.751992 28250 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:42559
I20260811 07:29:59.752314 28326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:42559 every 8 connection(s)
I20260811 07:29:59.753351 28250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:29:59.758410 28328 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:29:59.758863 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28250
I20260811 07:29:59.759339 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:34693
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:42559
--webserver_port=37911
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:29:59.760416 28328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap starting.
I20260811 07:29:59.778791 28328 log.cc:824] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:59.788041 28328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:29:59.788494 28328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap complete.
I20260811 07:29:59.792790 28328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:59.793341 28328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83dd90d3e81f4bfb84dd57c3deb538af, State: Initialized, Role: FOLLOWER
I20260811 07:29:59.793833 28328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:59.793983 28328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:29:59.794081 28328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:29:59.794206 28328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:29:59.796224 28328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:59.796586 28328 leader_election.cc:302] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83dd90d3e81f4bfb84dd57c3deb538af; no voters:
I20260811 07:29:59.797029 28328 leader_election.cc:288] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:29:59.797122 28332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:29:59.797333 28332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 LEADER]: Becoming Leader. State: Replica: 83dd90d3e81f4bfb84dd57c3deb538af, State: Running, Role: LEADER
I20260811 07:29:59.797631 28332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:29:59.798353 28328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:29:59.799084 28333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } } }
I20260811 07:29:59.799221 28333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:59.799841 28340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:29:59.800294 28334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83dd90d3e81f4bfb84dd57c3deb538af. Latest consensus state: current_term: 2 leader_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } } }
I20260811 07:29:59.800464 28334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: This master's current role is: LEADER
I20260811 07:29:59.804780 28340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:29:59.805456 28340 catalog_manager.cc:1259] Loaded cluster ID: 31ded244de85405595c2f722fda8af6a
I20260811 07:29:59.805593 28340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:29:59.807050 28340 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 07:29:59.811987 28340 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 07:29:59.817891 28340 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:29:59.818707 28340 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Loaded TSK: 0
I20260811 07:29:59.819921 28340 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:29:59.881057 28330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:29:59.881358 28330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:29:59.881438 28330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:29:59.885612 28330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:29:59.885722 28330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:29:59.885818 28330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:29:59.891281 28330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:34693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=37911
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:29:59.892373 28330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:29:59.893430 28330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:29:59.903473 28357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:29:59.903437 28358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:59.903688 28330 server_base.cc:1034] running on GCE node
W20260811 07:29:59.904003 28360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:29:59.904495 28330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:29:59.905381 28330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:29:59.906591 28330 hybrid_clock.cc:648] HybridClock initialized: now 1786433399906571 us; error 41 us; skew 500 ppm
Aug 11 07:29:59 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:29:59.909772 28330 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:29:59.910972 28330 webserver.cc:460] Webserver started at http://127.11.248.1:37911/ using document root <none> and password file <none>
I20260811 07:29:59.911580 28330 fs_manager.cc:359] Metadata directory not provided
I20260811 07:29:59.911698 28330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:29:59.916342 28330 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:59.918757 28369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:29:59.920094 28330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:29:59.920254 28330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "ed108755da3d4fc283ad3792bd98fd38"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "bfc740d88e24d500da4e6b13d36ecb52"
server_key_iv: "6c1f928c274cf5d76cc01147e71d5b12"
server_key_version: "encryptionkey@0"
I20260811 07:29:59.920881 28330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:29:59.944342 28330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:29:59.947875 28330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:29:59.948135 28330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:29:59.948869 28330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:29:59.950145 28377 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:29:59.954501 28330 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:29:59.954593 28330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 07:29:59.954677 28330 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:29:59.956580 28330 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:29:59.956645 28330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 07:29:59.956921 28377 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Bootstrap starting.
I20260811 07:29:59.968276 28330 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:34693
I20260811 07:29:59.968343 28501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:34693 every 8 connection(s)
I20260811 07:29:59.969734 28330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:29:59.977846 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28330
I20260811 07:29:59.978197 28377 log.cc:824] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Log is configured to *not* fsync() on all Append() calls
I20260811 07:29:59.978385 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:34087
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:42559
--webserver_port=37419
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:29:59 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:29:59.986565 28377 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:29:59.987011 28377 tablet_bootstrap.cc:492] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Bootstrap complete.
I20260811 07:29:59.988176 28377 ts_tablet_manager.cc:1397] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Time spent bootstrapping tablet: real 0.032s user 0.024s sys 0.004s
I20260811 07:29:59.989678 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.971966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:59199 (local address 127.11.248.62:42559)
0811 07:29:59.972354 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.972369 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:29:59.972788 (+ 419us) server_negotiation.cc:407] Connection header received
0811 07:29:59.973967 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:29:59.973978 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:29:59.974295 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:29:59.974631 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:29:59.975780 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.976749 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.978337 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.979095 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.979315 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.982443 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:29:59.982461 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:29:59.982482 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:29:59.982527 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:29:59.985127 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:59.985946 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:59.985953 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:59.985960 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:59.986151 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:29:59.986670 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:29:59.986676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:29:59.986680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:29:59.987243 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:29:59.987394 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:29:59.988509 (+ 1115us) server_negotiation.cc:299] Negotiation successful
0811 07:29:59.988861 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":136,"threads_started":1}
I20260811 07:29:59.989744 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.971956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:59199)
0811 07:29:59.972605 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0811 07:29:59.972647 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 07:29:59.973536 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:29:59.974683 (+ 1147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:29:59.974690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:29:59.975133 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:29:59.975587 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.975602 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.977010 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.977013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.978179 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:29:59.978192 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:29:59.979279 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:29:59.979283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:29:59.979481 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:29:59.980173 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:29:59.980191 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:29:59.982199 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:29:59.985312 (+ 3113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:59.985320 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:59.985339 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:59.985775 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:59.986286 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:29:59.986291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:29:59.986294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:29:59.986527 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:29:59.987482 (+ 955us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:29:59.987490 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:29:59.987838 (+ 348us) client_negotiation.cc:769] Sending connection context
0811 07:29:59.988073 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 07:29:59.988514 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":184,"threads_started":1}
I20260811 07:29:59.991151 28377 raft_consensus.cc:348] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.991652 28377 raft_consensus.cc:729] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed108755da3d4fc283ad3792bd98fd38, State: Initialized, Role: FOLLOWER
I20260811 07:29:59.992147 28377 consensus_queue.cc:260] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:29:59.992789 28502 heartbeater.cc:347] Connected to a master server at 127.11.248.62:42559
I20260811 07:29:59.993124 28502 heartbeater.cc:464] Registering TS with master...
I20260811 07:29:59.993297 28377 ts_tablet_manager.cc:1428] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260811 07:29:59.993747 28502 heartbeater.cc:511] Master 127.11.248.62:42559 requested a full tablet report, sending...
I20260811 07:29:59.996411 28285 ts_manager.cc:194] Registered new tserver with Master: ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:30:00.000063 28285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:59199
I20260811 07:30:00.003055 28502 heartbeater.cc:503] Master 127.11.248.62:42559 was elected leader, sending a full tablet report...
Aug 11 07:30:00 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:30:00.011283 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.999478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.0.0.1:56710)
0811 07:30:00.000353 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.000403 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.000559 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.001233 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.001239 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.001623 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:00.001734 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.001741 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.002755 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.002760 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.003492 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.003506 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.004436 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.004440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.004557 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.005272 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:00.005287 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:00.006765 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:00.009323 (+ 2558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:00.009335 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:00.009340 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:00.009643 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:00.009996 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:00.009999 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:00.010000 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:00.010095 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:00.010659 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:00.010665 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:00.010793 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.010928 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.011120 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":129,"threads_started":1}
I20260811 07:30:00.011385 28512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:29:59.999544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56710 (local address 127.11.248.1:34693)
0811 07:29:59.999927 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 07:29:59.999972 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.000528 (+ 556us) server_negotiation.cc:407] Connection header received
0811 07:30:00.000780 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.000786 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.001059 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.001215 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:00.001883 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.002611 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.003644 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.004288 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.004411 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.006930 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:00.006943 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:00.006957 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:00.006988 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:00.009141 (+ 2153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.009775 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.009782 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.009784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.009885 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.010193 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.010196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.010198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.010533 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:00.010667 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.011035 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.011217 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":97,"threads_started":1}
I20260811 07:30:00.012760 28429 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c9cccab35c94741849c3f55c7201937 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:29:59 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:56710
I20260811 07:30:00.013818 28513 tablet_replica.cc:330] stopping tablet replica
I20260811 07:30:00.014118 28513 raft_consensus.cc:2229] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:30:00.014350 28513 raft_consensus.cc:2258] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:00.015355 28513 ts_tablet_manager.cc:1905] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:00.019605 28513 ts_tablet_manager.cc:1918] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:00.019721 28513 log.cc:1196] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/3c9cccab35c94741849c3f55c7201937
I20260811 07:30:00.020071 28513 ts_tablet_manager.cc:1939] T 3c9cccab35c94741849c3f55c7201937 P ed108755da3d4fc283ad3792bd98fd38: Deleting consensus metadata
I20260811 07:30:00.022078 28272 catalog_manager.cc:4841] TS ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693): tablet 3c9cccab35c94741849c3f55c7201937 (table test-table [id=c561c0c7c07c46d18cdb382836742389]) successfully deleted
W20260811 07:30:00.107874 28509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:00.108232 28509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:00.108319 28509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:00.112586 28509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:00.112695 28509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:00.112787 28509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:30:00.118507 28509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:34087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=37419
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:00.119688 28509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:00.120759 28509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:00.131284 28519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:00.131278 28521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:00.131273 28518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:00.131561 28509 server_base.cc:1034] running on GCE node
I20260811 07:30:00.132272 28509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:00.133044 28509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:00.134266 28509 hybrid_clock.cc:648] HybridClock initialized: now 1786433400134253 us; error 33 us; skew 500 ppm
Aug 11 07:30:00 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:00.137347 28509 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:30:00.138357 28509 webserver.cc:460] Webserver started at http://127.11.248.2:37419/ using document root <none> and password file <none>
I20260811 07:30:00.138962 28509 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:00.139088 28509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:00.143237 28509 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:30:00.145529 28530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.146938 28509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:30:00.147105 28509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "793c952b7c58481797abf762a6880361"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "8a1c2c348e7916f12739e9a3db70d657"
server_key_iv: "bbc1482bcb6b71db326a8cb17adb24b7"
server_key_version: "encryptionkey@0"
I20260811 07:30:00.147692 28509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:00.175705 28509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:00.179227 28509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:00.179471 28509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:00.180124 28509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:00.181041 28509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:00.181120 28509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.181200 28509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:00.181244 28509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.191042 28509 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:34087
I20260811 07:30:00.191139 28663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:34087 every 8 connection(s)
I20260811 07:30:00.192171 28509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:30:00.199098 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28509
I20260811 07:30:00.199597 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:46115
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:42559
--webserver_port=42629
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:30:00 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:00.208218 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.194384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:47783 (local address 127.11.248.62:42559)
0811 07:30:00.194542 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.194547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.195560 (+ 1013us) server_negotiation.cc:407] Connection header received
0811 07:30:00.197126 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.197130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.197204 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.197315 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:00.198810 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.199443 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.200943 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.201215 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.201349 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.204040 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:00.204044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:00.204047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:00.204081 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:00.205933 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.206533 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.206537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.206539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.206631 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.207019 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.207023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.207025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.207242 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:00.207362 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.207891 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.208045 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:30:00.209230 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.194791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:47783)
0811 07:30:00.195364 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.195424 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.196768 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.197514 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.197521 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.198030 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:00.198634 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.198652 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.199582 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.199588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.200695 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.200705 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.201391 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.201395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.201593 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.202262 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:00.202279 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:00.203835 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:00.206062 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:00.206069 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:00.206088 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:00.206398 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:00.206730 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:00.206734 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:00.206737 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:00.206917 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:00.207355 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:00.207362 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:00.207641 (+ 279us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.207854 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.208219 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":151,"threads_started":1}
I20260811 07:30:00.210510 28664 heartbeater.cc:347] Connected to a master server at 127.11.248.62:42559
I20260811 07:30:00.210815 28664 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:00.211519 28664 heartbeater.cc:511] Master 127.11.248.62:42559 requested a full tablet report, sending...
I20260811 07:30:00.212739 28285 ts_manager.cc:194] Registered new tserver with Master: 793c952b7c58481797abf762a6880361 (127.11.248.2:34087)
I20260811 07:30:00.213562 28285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:47783
W20260811 07:30:00.317410 28667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:00.317689 28667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:00.317734 28667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:00.321803 28667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:00.321871 28667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:00.321933 28667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:30:00.327667 28667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:46115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=42629
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:00.328785 28667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:00.329874 28667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:00.340333 28679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:00.340397 28675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:00.340329 28676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:00.340667 28667 server_base.cc:1034] running on GCE node
I20260811 07:30:00.341223 28667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:00.342006 28667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:00.343206 28667 hybrid_clock.cc:648] HybridClock initialized: now 1786433400343184 us; error 37 us; skew 500 ppm
Aug 11 07:30:00 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:00.346449 28667 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:30:00.347492 28667 webserver.cc:460] Webserver started at http://127.11.248.3:42629/ using document root <none> and password file <none>
I20260811 07:30:00.348181 28667 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:00.348308 28667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:00.352878 28667 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:30:00.355347 28690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.357003 28667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:00.357167 28667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "898e097f4b574b1cafc4eb92bf41d3fe"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "fce8c9df186a458bcef7f895030e6d9e"
server_key_iv: "9d40d60eb8be7976e206f82d3c0a81b7"
server_key_version: "encryptionkey@0"
I20260811 07:30:00.357795 28667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:00.383122 28667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:00.386956 28667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:00.387293 28667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:00.388033 28667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:00.389024 28667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:00.389098 28667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.389175 28667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:00.389220 28667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.399816 28667 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:46115
I20260811 07:30:00.399893 28826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:46115 every 8 connection(s)
I20260811 07:30:00.401094 28667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:30:00.408586 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28667
Aug 11 07:30:00 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:00.416889 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.403029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:42395 (local address 127.11.248.62:42559)
0811 07:30:00.403174 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.403186 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.404062 (+ 876us) server_negotiation.cc:407] Connection header received
0811 07:30:00.405841 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.405845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.405909 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.405993 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:00.407254 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.407795 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.409168 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.409537 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.409663 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.412568 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:00.412571 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:00.412574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:00.412602 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:00.414296 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.414934 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.414938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.414940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.415023 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.415533 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.415540 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.415544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.415805 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:00.415912 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.416511 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.416670 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:30:00.417855 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.403416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:42395)
0811 07:30:00.403899 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.403943 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.405612 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.406188 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.406195 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.406590 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:00.407088 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.407101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.407930 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.407933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.408950 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.408960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.409719 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.409727 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.409954 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.410687 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:00.410703 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:00.412396 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:00.414422 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:00.414430 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:00.414451 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:00.414822 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:00.415128 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:00.415153 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:00.415157 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:00.415379 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:00.415931 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:00.415941 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:00.416234 (+ 293us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.416423 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.416693 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":127,"threads_started":1}
I20260811 07:30:00.418751 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.409542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56020 (local address 127.11.248.62:42559)
0811 07:30:00.409844 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.409848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.410007 (+ 159us) server_negotiation.cc:407] Connection header received
0811 07:30:00.410086 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.410089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.410140 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.410256 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:00.411142 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.411794 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.412868 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.413129 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.413246 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.414819 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:00.414822 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:00.414824 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:00.414846 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:00.416662 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.417257 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.417260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.417262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.417350 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:00.417669 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:00.417673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:00.417674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:00.417867 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:00.418125 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.418444 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.418577 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":124,"threads_started":1}
I20260811 07:30:00.419181 28827 heartbeater.cc:347] Connected to a master server at 127.11.248.62:42559
I20260811 07:30:00.419456 28827 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:00.420030 28827 heartbeater.cc:511] Master 127.11.248.62:42559 requested a full tablet report, sending...
I20260811 07:30:00.421088 28285 ts_manager.cc:194] Registered new tserver with Master: 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115)
I20260811 07:30:00.421612 28285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:42395
I20260811 07:30:00.433116 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:30:00.438498 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.433912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56028 (local address 127.11.248.62:42559)
0811 07:30:00.434092 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.434098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.434348 (+ 250us) server_negotiation.cc:407] Connection header received
0811 07:30:00.434583 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.434586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.434709 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.434847 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:30:00.435143 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.435754 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.436713 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.437068 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.437201 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.437577 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:30:00.438028 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:30:00.438183 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.438254 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.438333 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:30:00.439432 28285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:30:00.443324 28285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:30:00.451550 28429 tablet_service.cc:1467] Processing CreateTablet for tablet 633ac952edaa441092651dfe4076752e (DEFAULT_TABLE table=test-table [id=c5a0969c3b004bf4800873d9b93f2196]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:00.452275 28429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633ac952edaa441092651dfe4076752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:00.455626 28377 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Bootstrap starting.
I20260811 07:30:00.456449 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.450098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34087 (local address 127.0.0.1:47388)
0811 07:30:00.450558 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.450575 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.450671 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.451353 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.451357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.451375 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:00.451507 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.451514 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.453210 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.453214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.454647 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.454660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.455964 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.455968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.456074 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.456137 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.456206 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.456299 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":5}
I20260811 07:30:00.456632 28377 tablet_bootstrap.cc:654] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:00.457113 28839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.450152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:46115 (local address 127.0.0.1:39046)
0811 07:30:00.450675 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.450691 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.450786 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.451863 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.451868 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.451886 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:00.451986 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.451992 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.454020 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.454026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.454977 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.454987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.456569 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.456574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.456705 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.456734 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.456867 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.456970 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":39,"thread_start_us":225,"threads_started":1}
I20260811 07:30:00.457592 28842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.450284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47388 (local address 127.11.248.2:34087)
0811 07:30:00.450789 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.450801 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.450825 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:30:00.450912 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.450918 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.451140 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.451701 (+ 561us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:00.451887 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.453088 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.454808 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.455653 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.457122 (+ 1469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.457306 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.457365 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.457478 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":143,"threads_started":1}
I20260811 07:30:00.457676 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.451000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.11.248.3:46115)
0811 07:30:00.451408 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.451420 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.451442 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:30:00.451513 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.451518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.451705 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.452128 (+ 423us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:00.452277 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.453878 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.455122 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.456405 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.456538 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.456691 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.457362 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.457516 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":178,"threads_started":1}
I20260811 07:30:00.458926 28377 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: No bootstrap required, opened a new log
I20260811 07:30:00.459029 28377 ts_tablet_manager.cc:1397] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:00.459509 28377 raft_consensus.cc:348] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.460453 28377 raft_consensus.cc:374] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:00.460515 28377 raft_consensus.cc:729] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed108755da3d4fc283ad3792bd98fd38, State: Initialized, Role: FOLLOWER
I20260811 07:30:00.460724 28377 consensus_queue.cc:260] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.460568 28587 tablet_service.cc:1467] Processing CreateTablet for tablet 633ac952edaa441092651dfe4076752e (DEFAULT_TABLE table=test-table [id=c5a0969c3b004bf4800873d9b93f2196]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:00.460789 28749 tablet_service.cc:1467] Processing CreateTablet for tablet 633ac952edaa441092651dfe4076752e (DEFAULT_TABLE table=test-table [id=c5a0969c3b004bf4800873d9b93f2196]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:00.461694 28377 ts_tablet_manager.cc:1428] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 07:30:00.462062 28749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633ac952edaa441092651dfe4076752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:00.462093 28587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633ac952edaa441092651dfe4076752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:00.469530 28846 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Bootstrap starting.
I20260811 07:30:00.470053 28848 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Bootstrap starting.
W20260811 07:30:00.471081 28505 tablet.cc:2369] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:30:00.472548 28846 tablet_bootstrap.cc:654] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:00.472654 28848 tablet_bootstrap.cc:654] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:00.473405 28846 log.cc:824] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:00.473479 28848 log.cc:824] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:00.475451 28846 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: No bootstrap required, opened a new log
I20260811 07:30:00.475461 28848 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: No bootstrap required, opened a new log
I20260811 07:30:00.475666 28846 ts_tablet_manager.cc:1397] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:30:00.475669 28848 ts_tablet_manager.cc:1397] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:30:00.478794 28846 raft_consensus.cc:348] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.479077 28846 raft_consensus.cc:374] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:00.479135 28846 raft_consensus.cc:729] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793c952b7c58481797abf762a6880361, State: Initialized, Role: FOLLOWER
I20260811 07:30:00.478981 28848 raft_consensus.cc:348] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.479278 28848 raft_consensus.cc:374] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:00.479362 28848 raft_consensus.cc:729] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898e097f4b574b1cafc4eb92bf41d3fe, State: Initialized, Role: FOLLOWER
I20260811 07:30:00.479657 28846 consensus_queue.cc:260] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.479918 28848 consensus_queue.cc:260] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.480374 28664 heartbeater.cc:503] Master 127.11.248.62:42559 was elected leader, sending a full tablet report...
I20260811 07:30:00.480641 28827 heartbeater.cc:503] Master 127.11.248.62:42559 was elected leader, sending a full tablet report...
I20260811 07:30:00.480765 28846 ts_tablet_manager.cc:1428] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 07:30:00.481966 28848 ts_tablet_manager.cc:1428] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:30:00.637322 28851 raft_consensus.cc:482] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:30:00.637565 28851 raft_consensus.cc:504] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.638823 28851 leader_election.cc:288] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115), ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:30:00.643690 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.639280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:51909 (local address 127.11.248.1:34693)
0811 07:30:00.639622 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.639627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.639642 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:30:00.639698 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.639701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.639760 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.639894 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:00.640399 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.641087 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.642351 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.643078 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.643234 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.643431 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.643474 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.643552 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":151,"threads_started":1}
I20260811 07:30:00.643689 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.639141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.11.248.2:51909)
0811 07:30:00.639316 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.639334 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.639448 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.639912 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.639916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.639936 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:00.640216 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.640228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.641225 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.641233 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.642182 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.642197 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.643219 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.643223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.643335 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.643359 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.643430 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.643517 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":27}
I20260811 07:30:00.643958 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.639413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:53157 (local address 127.11.248.3:46115)
0811 07:30:00.639558 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.639563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.640044 (+ 481us) server_negotiation.cc:407] Connection header received
0811 07:30:00.640203 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.640206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.640266 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.640356 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:00.640650 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.641283 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.642602 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.643154 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.643288 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.643368 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.643736 (+ 368us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.643825 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:30:00.643978 28854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.639165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:46115 (local address 127.11.248.2:53157)
0811 07:30:00.639927 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.639939 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:00.640069 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:00.640381 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:00.640384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:00.640401 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:00.640530 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.640535 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.641411 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.641416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.642401 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:00.642411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.643444 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.643448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:00.643572 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.643596 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:30:00.643717 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 07:30:00.643797 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":440,"thread_start_us":126,"threads_started":1}
I20260811 07:30:00.644513 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "633ac952edaa441092651dfe4076752e" candidate_uuid: "793c952b7c58481797abf762a6880361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed108755da3d4fc283ad3792bd98fd38" is_pre_election: true
I20260811 07:30:00.644739 28776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "633ac952edaa441092651dfe4076752e" candidate_uuid: "793c952b7c58481797abf762a6880361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" is_pre_election: true
I20260811 07:30:00.644949 28431 raft_consensus.cc:2454] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 793c952b7c58481797abf762a6880361 in term 0.
I20260811 07:30:00.645124 28776 raft_consensus.cc:2454] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 793c952b7c58481797abf762a6880361 in term 0.
I20260811 07:30:00.645565 28535 leader_election.cc:302] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 793c952b7c58481797abf762a6880361, ed108755da3d4fc283ad3792bd98fd38; no voters:
I20260811 07:30:00.645907 28851 raft_consensus.cc:2781] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:30:00.646000 28851 raft_consensus.cc:482] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:30:00.646061 28851 raft_consensus.cc:3037] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:00.647286 28851 raft_consensus.cc:504] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:00.647719 28851 leader_election.cc:288] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [CANDIDATE]: Term 1 election: Requested vote from peers 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115), ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:30:00.648298 28776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "633ac952edaa441092651dfe4076752e" candidate_uuid: "793c952b7c58481797abf762a6880361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "898e097f4b574b1cafc4eb92bf41d3fe"
I20260811 07:30:00.648298 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "633ac952edaa441092651dfe4076752e" candidate_uuid: "793c952b7c58481797abf762a6880361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed108755da3d4fc283ad3792bd98fd38"
I20260811 07:30:00.648468 28776 raft_consensus.cc:3037] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:00.648468 28431 raft_consensus.cc:3037] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:00.650154 28431 raft_consensus.cc:2454] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 793c952b7c58481797abf762a6880361 in term 1.
I20260811 07:30:00.650154 28776 raft_consensus.cc:2454] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 793c952b7c58481797abf762a6880361 in term 1.
I20260811 07:30:00.650566 28535 leader_election.cc:302] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 793c952b7c58481797abf762a6880361, ed108755da3d4fc283ad3792bd98fd38; no voters:
I20260811 07:30:00.650801 28851 raft_consensus.cc:2781] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:30:00.651052 28851 raft_consensus.cc:686] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 LEADER]: Becoming Leader. State: Replica: 793c952b7c58481797abf762a6880361, State: Running, Role: LEADER
I20260811 07:30:00.651451 28851 consensus_queue.cc:237] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
W20260811 07:30:00.652112 28829 tablet.cc:2369] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:30:00.655139 28285 catalog_manager.cc:5495] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 reported cstate change: term changed from 0 to 1, leader changed from <none> to 793c952b7c58481797abf762a6880361 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "793c952b7c58481797abf762a6880361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } health_report { overall_health: UNKNOWN } } }
W20260811 07:30:00.693439 28665 tablet.cc:2369] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:30:00.698689 28842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.694915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47390 (local address 127.11.248.2:34087)
0811 07:30:00.695067 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:00.695071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:00.695086 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:30:00.695222 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:00.695225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:00.695281 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:00.695374 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:30:00.695603 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.696110 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.697146 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:00.697351 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:00.697428 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:00.697707 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:30:00.698129 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:30:00.698221 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:00.698429 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 07:30:00.698484 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:30:00.704937 28431 raft_consensus.cc:1261] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Refusing update from remote peer 793c952b7c58481797abf762a6880361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:30:00.704993 28776 raft_consensus.cc:1261] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Refusing update from remote peer 793c952b7c58481797abf762a6880361: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:30:00.705796 28855 consensus_queue.cc:1035] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:30:00.706014 28851 consensus_queue.cc:1035] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:30:00.711776 28858 mvcc.cc:205] Tried to move back new op lower bound from 7317231209279959040 to 7317231209071919104. Current Snapshot: MvccSnapshot[applied={T|T < 7317231209279959040}]
I20260811 07:30:00.712906 28859 mvcc.cc:205] Tried to move back new op lower bound from 7317231209279959040 to 7317231209071919104. Current Snapshot: MvccSnapshot[applied={T|T < 7317231209279959040}]
I20260811 07:30:00.721958 28284 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:30:00.722180 28284 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:30:00.725414 28284 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Sending DeleteTablet for 3 replicas of tablet 633ac952edaa441092651dfe4076752e
I20260811 07:30:00.726212 28429 tablet_service.cc:1514] Processing DeleteTablet for tablet 633ac952edaa441092651dfe4076752e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:00 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:56710
I20260811 07:30:00.726313 28587 tablet_service.cc:1514] Processing DeleteTablet for tablet 633ac952edaa441092651dfe4076752e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:00 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:47388
I20260811 07:30:00.726421 28749 tablet_service.cc:1514] Processing DeleteTablet for tablet 633ac952edaa441092651dfe4076752e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:00 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:39046
I20260811 07:30:00.726801 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 28330
I20260811 07:30:00.726985 28874 tablet_replica.cc:330] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: stopping tablet replica
I20260811 07:30:00.728022 28874 raft_consensus.cc:2229] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:30:00.728358 28874 raft_consensus.cc:2258] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:00.730253 28874 ts_tablet_manager.cc:1905] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:00.733103 28873 tablet_replica.cc:330] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: stopping tablet replica
I20260811 07:30:00.733537 28873 raft_consensus.cc:2229] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:30:00.734025 28873 raft_consensus.cc:2258] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:00.734125 28874 ts_tablet_manager.cc:1918] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:00.734256 28874 log.cc:1196] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/633ac952edaa441092651dfe4076752e
I20260811 07:30:00.734688 28874 ts_tablet_manager.cc:1939] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Deleting consensus metadata
I20260811 07:30:00.735888 28873 ts_tablet_manager.cc:1905] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:00.736225 28270 catalog_manager.cc:4841] TS 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115): tablet 633ac952edaa441092651dfe4076752e (table test-table [id=c5a0969c3b004bf4800873d9b93f2196]) successfully deleted
W20260811 07:30:00.737280 28272 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:34693 (error 108)
I20260811 07:30:00.737303 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 28509
I20260811 07:30:00.739482 28839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.739178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.0.0.1:56724)
0811 07:30:00.739330 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.739404 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:34693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 07:30:00.739689 28272 catalog_manager.cc:4584] TS ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 633ac952edaa441092651dfe4076752e: Network error: Client connection negotiation failed: client connection to 127.11.248.1:34693: connect: Connection refused (error 111)
I20260811 07:30:00.745576 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 28667
I20260811 07:30:00.747123 28839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:00.745940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34087 (local address 127.0.0.1:47402)
0811 07:30:00.746902 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:00.746998 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.2:34087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":842}
I20260811 07:30:00.755528 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 28250
I20260811 07:30:00.764997 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42559
--webserver_interface=127.11.248.62
--webserver_port=43973
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:42559
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:30:00.882560 28877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:00.882894 28877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:00.882973 28877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:00.887154 28877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:30:00.887287 28877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:00.887326 28877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:00.887372 28877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:30:00.887430 28877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:30:00.893093 28877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:42559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=43973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:00.894289 28877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:00.895431 28877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:00.904621 28887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:00.904722 28885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:00.904922 28877 server_base.cc:1034] running on GCE node
W20260811 07:30:00.904868 28884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:00.905645 28877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:00.906823 28877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:00.908039 28877 hybrid_clock.cc:648] HybridClock initialized: now 1786433400908009 us; error 44 us; skew 500 ppm
Aug 11 07:30:00 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:00.911317 28877 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:30:00.912227 28877 webserver.cc:460] Webserver started at http://127.11.248.62:43973/ using document root <none> and password file <none>
I20260811 07:30:00.913061 28877 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:00.913179 28877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:00.918059 28877 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 07:30:00.920549 28894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:00.922071 28877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:30:00.922245 28877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "83dd90d3e81f4bfb84dd57c3deb538af"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "6037e024b5ce60e5857b153b485ca808"
server_key_iv: "738808a85a473f7a6d7ed8282c114715"
server_key_version: "encryptionkey@0"
I20260811 07:30:00.922988 28877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:00.953138 28877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:00.957224 28877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:00.957473 28877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:00.966012 28877 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:42559
I20260811 07:30:00.966318 28958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:42559 every 8 connection(s)
I20260811 07:30:00.967371 28877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:30:00.972213 28959 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:30:00.973932 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28877
I20260811 07:30:00.974319 28959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap starting.
I20260811 07:30:00.974475 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:34693
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:42559
--webserver_port=37911
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:30:00.994029 28959 log.cc:824] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:01.005676 28959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:30:01.006129 28959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af: Bootstrap complete.
I20260811 07:30:01.010535 28959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:30:01.010972 28959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83dd90d3e81f4bfb84dd57c3deb538af, State: Initialized, Role: FOLLOWER
I20260811 07:30:01.011533 28959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:30:01.011660 28959 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:30:01.011749 28959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:30:01.011871 28959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:30:01.014040 28959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:30:01.014398 28959 leader_election.cc:302] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83dd90d3e81f4bfb84dd57c3deb538af; no voters:
I20260811 07:30:01.014776 28959 leader_election.cc:288] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:30:01.014880 28963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:30:01.015111 28963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [term 3 LEADER]: Becoming Leader. State: Replica: 83dd90d3e81f4bfb84dd57c3deb538af, State: Running, Role: LEADER
I20260811 07:30:01.015489 28963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } }
I20260811 07:30:01.016165 28959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:30:01.016549 28965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83dd90d3e81f4bfb84dd57c3deb538af. Latest consensus state: current_term: 3 leader_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } } }
I20260811 07:30:01.016686 28965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: This master's current role is: LEADER
I20260811 07:30:01.017081 28964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83dd90d3e81f4bfb84dd57c3deb538af" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42559 } } }
I20260811 07:30:01.017212 28964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83dd90d3e81f4bfb84dd57c3deb538af [sys.catalog]: This master's current role is: LEADER
I20260811 07:30:01.017139 28967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:30:01.023000 28967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:30:01.023741 28967 catalog_manager.cc:1259] Loaded cluster ID: 31ded244de85405595c2f722fda8af6a
I20260811 07:30:01.023818 28967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 07:30:01.025067 28967 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f06ec5b39ad google::LogMessage::Fail() at ??:0
@ 0x7f06ec5b688a google::LogMessage::SendToLog() at ??:0
@ 0x7f06ec5b34de google::LogMessage::Flush() at ??:0
@ 0x7f06ec5b4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f06f6ef2fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f06f6ef3d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f06f6ef0579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f06f6f34640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f06ee8053d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f06ee805c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f06ee8073f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f06ee7f6512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f06efe3a6db start_thread at ??:0
@ 0x7f06eb0b161f clone at ??:0
W20260811 07:30:01.133659 28961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:01.134068 28961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:01.134148 28961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:01.140396 28961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:01.140501 28961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:01.140591 28961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:30:01.149120 28961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:34693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=37911
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:01.150647 28961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:01.152000 28961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:01.163889 29006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:01.163889 29008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:01.164193 29010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:01.164388 28961 server_base.cc:1034] running on GCE node
I20260811 07:30:01.164945 28961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:01.165841 28961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:01.167068 28961 hybrid_clock.cc:648] HybridClock initialized: now 1786433401167030 us; error 56 us; skew 500 ppm
Aug 11 07:30:01 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:01.171471 28961 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:30:01.172844 28961 webserver.cc:460] Webserver started at http://127.11.248.1:37911/ using document root <none> and password file <none>
I20260811 07:30:01.173689 28961 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:01.173787 28961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:01.180092 28961 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:30:01.183210 29019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:01.185312 28961 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:30:01.185489 28961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "ed108755da3d4fc283ad3792bd98fd38"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "bfc740d88e24d500da4e6b13d36ecb52"
server_key_iv: "6c1f928c274cf5d76cc01147e71d5b12"
server_key_version: "encryptionkey@0"
I20260811 07:30:01.186308 28961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:01.206275 28961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:01.211042 28961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:01.211283 28961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:01.212126 28961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:01.213610 29027 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:30:01.220284 28961 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:30:01.220489 28961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.001s
I20260811 07:30:01.220644 28961 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:30:01.223256 28961 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:30:01.223452 28961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.001s
I20260811 07:30:01.223640 29027 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Bootstrap starting.
I20260811 07:30:01.235224 28961 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:34693
I20260811 07:30:01.236622 28961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:30:01.237730 29146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:34693 every 8 connection(s)
I20260811 07:30:01.244565 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 28961
I20260811 07:30:01.245275 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:34087
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:42559
--webserver_port=37419
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:30:01.250101 29027 log.cc:824] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:01.257866 29027 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:30:01.258306 29027 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Bootstrap complete.
I20260811 07:30:01.259441 29027 ts_tablet_manager.cc:1397] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Time spent bootstrapping tablet: real 0.036s user 0.020s sys 0.009s
I20260811 07:30:01.262128 29027 raft_consensus.cc:348] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:01.262583 29027 raft_consensus.cc:729] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed108755da3d4fc283ad3792bd98fd38, State: Initialized, Role: FOLLOWER
I20260811 07:30:01.263159 29027 consensus_queue.cc:260] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:01.264213 29027 ts_tablet_manager.cc:1428] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
W20260811 07:30:01.302438 29150 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:30:01.240733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:53467)
0811 07:30:01.241374 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.241437 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:01.242696 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:01.301603 (+ 58907us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":176,"threads_started":1}
W20260811 07:30:01.303090 29147 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:42559 (0 consecutive failures): Network error: Failed to ping master at 127.11.248.62:42559: Client connection negotiation failed: client connection to 127.11.248.62:42559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:30:01.303845 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.303577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:54053)
0811 07:30:01.303710 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.303791 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 07:30:01.304646 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.304380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:53469)
0811 07:30:01.304510 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.304576 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:30:01.304893 29147 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:30:01.381259 29151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:01.381577 29151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:01.381623 29151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:01.386153 29151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:01.386241 29151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:01.386307 29151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:30:01.392122 29151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:34087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=37419
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:01.393499 29151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:01.394682 29151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:01.405601 29160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:01.405815 29164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:01.405689 29151 server_base.cc:1034] running on GCE node
W20260811 07:30:01.405632 29162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:01.406301 29151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:01.406998 29151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:01.408207 29151 hybrid_clock.cc:648] HybridClock initialized: now 1786433401408181 us; error 51 us; skew 500 ppm
Aug 11 07:30:01 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:01.411383 29151 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:30:01.412492 29151 webserver.cc:460] Webserver started at http://127.11.248.2:37419/ using document root <none> and password file <none>
I20260811 07:30:01.413244 29151 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:01.413352 29151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:01.417616 29151 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 07:30:01.420053 29171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:01.421504 29151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:30:01.421662 29151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "793c952b7c58481797abf762a6880361"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "8a1c2c348e7916f12739e9a3db70d657"
server_key_iv: "bbc1482bcb6b71db326a8cb17adb24b7"
server_key_version: "encryptionkey@0"
I20260811 07:30:01.422334 29151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:01.451689 29151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:01.455644 29151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:01.455881 29151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:01.456588 29151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:01.457903 29178 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:30:01.462489 29151 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:30:01.462620 29151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 07:30:01.462714 29151 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:30:01.464730 29151 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:30:01.464812 29151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 07:30:01.465173 29178 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Bootstrap starting.
I20260811 07:30:01.471678 29178 log.cc:824] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:01.476082 29151 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:34087
I20260811 07:30:01.476162 29306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:34087 every 8 connection(s)
I20260811 07:30:01.477090 29151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:30:01.480208 29178 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:30:01.480583 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.479004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:49189)
0811 07:30:01.479552 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.479694 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":132,"threads_started":1}
I20260811 07:30:01.480695 29178 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Bootstrap complete.
W20260811 07:30:01.481046 29307 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:42559 (0 consecutive failures): Network error: Failed to ping master at 127.11.248.62:42559: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
I20260811 07:30:01.481083 29178 ts_tablet_manager.cc:1397] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.004s
I20260811 07:30:01.481791 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.481539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:59581)
0811 07:30:01.481669 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.481726 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 07:30:01.482481 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.482250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:51241)
0811 07:30:01.482367 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.482419 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 07:30:01.482687 29307 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:30:01.484329 29178 raft_consensus.cc:348] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:01.484753 29178 raft_consensus.cc:729] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793c952b7c58481797abf762a6880361, State: Initialized, Role: FOLLOWER
I20260811 07:30:01.485240 29178 consensus_queue.cc:260] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:01.485486 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 29151
I20260811 07:30:01.486078 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:46115
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:42559
--webserver_port=42629
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:30:01.486325 29178 ts_tablet_manager.cc:1428] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 07:30:01.486399 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.486133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:60487)
0811 07:30:01.486284 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.486335 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 07:30:01.487080 29309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.486838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:38193)
0811 07:30:01.486961 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.487018 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 07:30:01.602221 29312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:01.602515 29312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:01.602598 29312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:01.606899 29312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:01.607000 29312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:01.607100 29312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:30:01.612597 29312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:46115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=42629
--tserver_master_addrs=127.11.248.62:42559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:01.613901 29312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:01.614971 29312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:01.625023 29318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:01.625126 29321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:01.625108 29312 server_base.cc:1034] running on GCE node
W20260811 07:30:01.625051 29317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:01.625823 29312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:01.626518 29312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:01.627769 29312 hybrid_clock.cc:648] HybridClock initialized: now 1786433401627741 us; error 52 us; skew 500 ppm
Aug 11 07:30:01 dist-test-slave-77v9 krb5kdc[27621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:01.630744 29312 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:30:01.631621 29312 webserver.cc:460] Webserver started at http://127.11.248.3:42629/ using document root <none> and password file <none>
I20260811 07:30:01.632153 29312 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:01.632215 29312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:01.636253 29312 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:30:01.638515 29328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:01.639938 29312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:30:01.640051 29312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "898e097f4b574b1cafc4eb92bf41d3fe"
format_stamp: "Formatted at 2026-08-11 07:29:58 on dist-test-slave-77v9"
server_key: "fce8c9df186a458bcef7f895030e6d9e"
server_key_iv: "9d40d60eb8be7976e206f82d3c0a81b7"
server_key_version: "encryptionkey@0"
I20260811 07:30:01.640614 29312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:01.667174 29312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:01.670939 29312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:01.671141 29312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:01.671741 29312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:01.672773 29312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:01.672888 29312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:01.672979 29312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:01.673022 29312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:01.683656 29312 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:46115
I20260811 07:30:01.683678 29454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:46115 every 8 connection(s)
I20260811 07:30:01.684876 29312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:30:01.689249 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.687296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:41563)
0811 07:30:01.687834 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.688273 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":127,"threads_started":1}
W20260811 07:30:01.689714 29456 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:42559 (0 consecutive failures): Network error: Failed to ping master at 127.11.248.62:42559: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
I20260811 07:30:01.690618 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.690359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:37387)
0811 07:30:01.690498 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.690553 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 07:30:01.691264 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:01.691053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:43805)
0811 07:30:01.691160 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:01.691207 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 07:30:01.691430 29456 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:30:01.694778 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 29312
I20260811 07:30:02.306088 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.305561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:56871)
0811 07:30:02.305905 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:02.305967 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":102,"threads_started":1}
I20260811 07:30:02.488456 29461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.487949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:48707)
0811 07:30:02.488242 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:02.488340 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":86,"threads_started":1}
I20260811 07:30:02.661339 29462 raft_consensus.cc:482] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:30:02.661554 29462 raft_consensus.cc:504] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:02.662693 29462 leader_election.cc:288] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 793c952b7c58481797abf762a6880361 (127.11.248.2:34087), 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115)
Aug 11 07:30:02 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.2@KRBTEST.COM
Aug 11 07:30:02 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.3@KRBTEST.COM
I20260811 07:30:02.679669 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.663241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49989 (local address 127.11.248.2:34087)
0811 07:30:02.663734 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:02.663753 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:02.663788 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:30:02.664006 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:02.664011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:02.664349 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:02.664667 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:02.666103 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.667298 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.668756 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.669491 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.669677 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:02.672959 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:02.672965 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:02.672980 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:02.673013 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:02.675553 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:02.676654 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:02.676659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:02.676663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:02.676861 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:02.677415 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:02.677418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:02.677420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:02.678056 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:02.678197 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:02.679111 (+ 914us) server_negotiation.cc:299] Negotiation successful
0811 07:30:02.679450 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":102,"threads_started":1}
I20260811 07:30:02.679670 29466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.663386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:58569 (local address 127.11.248.3:46115)
0811 07:30:02.663713 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:02.663725 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:02.663765 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:30:02.664451 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:02.664457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:02.664740 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:02.665117 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:02.666110 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.667387 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.668758 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.669511 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.669723 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:02.673413 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:02.673419 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:02.673429 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:02.673463 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:02.675790 (+ 2327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:02.676647 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:02.676654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:02.676660 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:02.676864 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:02.677415 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:02.677418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:02.677420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:02.678061 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:02.678197 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:02.679111 (+ 914us) server_negotiation.cc:299] Negotiation successful
0811 07:30:02.679457 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":88,"threads_started":1}
I20260811 07:30:02.679661 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.663017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:34087 (local address 127.11.248.1:49989)
0811 07:30:02.663471 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:02.663486 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:02.663579 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:02.664719 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:02.664726 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:02.665388 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:02.665915 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:02.665930 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.667460 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.667464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:02.668592 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:02.668604 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.669632 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.669636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:02.669916 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:02.670814 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:02.670826 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:02.672695 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:02.675816 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:02.675823 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:02.675838 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:02.676494 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:02.676994 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:02.676998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:02.677001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:02.677279 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:02.678221 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:02.678230 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:02.678674 (+ 444us) client_negotiation.cc:769] Sending connection context
0811 07:30:02.678955 (+ 281us) client_negotiation.cc:240] Negotiation successful
0811 07:30:02.679443 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":315,"spinlock_wait_cycles":35584,"thread_start_us":82,"threads_started":1}
I20260811 07:30:02.681130 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.663017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:46115 (local address 127.11.248.1:58569)
0811 07:30:02.663280 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:02.663297 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:02.663410 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:02.665058 (+ 1648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:02.665061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:02.665405 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:02.665915 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:02.665930 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.667535 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.667539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:02.668587 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:02.668599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:02.669677 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:02.669682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:02.669915 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:02.670737 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:02.670771 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:02.673155 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:02.675922 (+ 2767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:02.675927 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:02.675933 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:02.676494 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:02.676994 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:02.676998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:02.677001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:02.677301 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:02.678221 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:02.678230 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:02.678674 (+ 444us) client_negotiation.cc:769] Sending connection context
0811 07:30:02.678955 (+ 281us) client_negotiation.cc:240] Negotiation successful
0811 07:30:02.680979 (+ 2024us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":1819,"spinlock_wait_cycles":63872}
I20260811 07:30:02.681699 29252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "633ac952edaa441092651dfe4076752e" candidate_uuid: "ed108755da3d4fc283ad3792bd98fd38" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "793c952b7c58481797abf762a6880361" is_pre_election: true
I20260811 07:30:02.682077 29252 raft_consensus.cc:2454] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed108755da3d4fc283ad3792bd98fd38 in term 1.
I20260811 07:30:02.683225 29024 leader_election.cc:302] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 793c952b7c58481797abf762a6880361, ed108755da3d4fc283ad3792bd98fd38; no voters:
W20260811 07:30:02.683512 29022 leader_election.cc:341] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115): Not found: Tablet not found: 633ac952edaa441092651dfe4076752e
I20260811 07:30:02.683573 29462 raft_consensus.cc:2781] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:30:02.683692 29462 raft_consensus.cc:482] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:30:02.683750 29462 raft_consensus.cc:3037] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:30:02.686060 29462 raft_consensus.cc:504] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:02.686561 29462 leader_election.cc:288] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [CANDIDATE]: Term 2 election: Requested vote from peers 793c952b7c58481797abf762a6880361 (127.11.248.2:34087), 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115)
I20260811 07:30:02.687083 29252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "633ac952edaa441092651dfe4076752e" candidate_uuid: "ed108755da3d4fc283ad3792bd98fd38" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "793c952b7c58481797abf762a6880361"
I20260811 07:30:02.687234 29252 raft_consensus.cc:3037] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 1 FOLLOWER]: Advancing to term 2
W20260811 07:30:02.687400 29022 leader_election.cc:341] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115): Not found: Tablet not found: 633ac952edaa441092651dfe4076752e
I20260811 07:30:02.690200 29252 raft_consensus.cc:2454] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed108755da3d4fc283ad3792bd98fd38 in term 2.
I20260811 07:30:02.690642 29024 leader_election.cc:302] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 793c952b7c58481797abf762a6880361, ed108755da3d4fc283ad3792bd98fd38; no voters: 898e097f4b574b1cafc4eb92bf41d3fe
I20260811 07:30:02.690908 29462 raft_consensus.cc:2781] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:30:02.691144 29462 raft_consensus.cc:686] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [term 2 LEADER]: Becoming Leader. State: Replica: ed108755da3d4fc283ad3792bd98fd38, State: Running, Role: LEADER
I20260811 07:30:02.691736 29462 consensus_queue.cc:237] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:02.692075 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.691785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:48645)
0811 07:30:02.691948 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:02.692000 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 07:30:02.692437 29469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:02.691929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:57669)
0811 07:30:02.692271 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:02.692334 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":95,"threads_started":1}
W20260811 07:30:03.093911 29022 consensus_peers.cc:487] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 -> Peer 898e097f4b574b1cafc4eb92bf41d3fe (127.11.248.3:46115): Couldn't send request to peer 898e097f4b574b1cafc4eb92bf41d3fe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 633ac952edaa441092651dfe4076752e. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:30:03.093875 29252 raft_consensus.cc:1261] T 633ac952edaa441092651dfe4076752e P 793c952b7c58481797abf762a6880361 [term 2 FOLLOWER]: Refusing update from remote peer ed108755da3d4fc283ad3792bd98fd38: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260811 07:30:03.094645 29462 consensus_queue.cc:1035] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260811 07:30:03.096961 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.096435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:34175)
0811 07:30:03.096689 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:03.096760 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":77,"threads_started":1}
I20260811 07:30:03.099535 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.099116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:58385)
0811 07:30:03.099340 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:03.099395 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260811 07:30:03.099766 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.099499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:56219)
0811 07:30:03.099626 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:03.099688 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:30:03.607393 29478 ts_tablet_manager.cc:927] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Initiating tablet copy from peer ed108755da3d4fc283ad3792bd98fd38 (127.11.248.1:34693)
I20260811 07:30:03.608078 29478 tablet_copy_client.cc:316] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: tablet copy: Beginning tablet copy session from remote peer at address 127.11.248.1:34693
Aug 11 07:30:03 dist-test-slave-77v9 krb5kdc[27621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:30:03.622872 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.608643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:34693 (local address 127.11.248.3:44047)
0811 07:30:03.609030 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:03.609050 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:03.609182 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:03.609618 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:03.609623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:03.610034 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:03.610150 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:03.610155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:03.611105 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:03.611107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:03.611786 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:03.611794 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:03.612434 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:03.612437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:03.612516 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:03.616953 (+ 4437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:03.616968 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:03.618661 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:03.621008 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:03.621021 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:03.621027 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:03.621301 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:03.621641 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:03.621643 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:03.621645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:03.621730 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:03.622321 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:03.622327 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:03.622451 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 07:30:03.622572 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 07:30:03.622727 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":248,"threads_started":1}
I20260811 07:30:03.622993 29483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.608859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44047 (local address 127.11.248.1:34693)
0811 07:30:03.609199 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:03.609205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:03.609230 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:30:03.609285 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:03.609289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:03.609469 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:03.609594 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:03.610273 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:03.611000 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:03.611936 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:03.612298 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:03.612406 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:03.618918 (+ 6512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:03.618935 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:03.618950 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:03.618982 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:03.620724 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:03.621438 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:03.621444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:03.621445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:03.621540 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:03.621874 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:03.621878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:03.621879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:03.622200 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:03.622321 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:03.622681 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 07:30:03.622830 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":63,"threads_started":1}
I20260811 07:30:03.624120 29116 tablet_copy_service.cc:140] P ed108755da3d4fc283ad3792bd98fd38: Received BeginTabletCopySession request for tablet 633ac952edaa441092651dfe4076752e from peer 898e097f4b574b1cafc4eb92bf41d3fe ({username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:44047)
I20260811 07:30:03.624339 29116 tablet_copy_service.cc:161] P ed108755da3d4fc283ad3792bd98fd38: Beginning new tablet copy session on tablet 633ac952edaa441092651dfe4076752e from peer 898e097f4b574b1cafc4eb92bf41d3fe at {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:44047: session id = 898e097f4b574b1cafc4eb92bf41d3fe-633ac952edaa441092651dfe4076752e
I20260811 07:30:03.625733 29116 tablet_copy_source_session.cc:205] T 633ac952edaa441092651dfe4076752e P ed108755da3d4fc283ad3792bd98fd38: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:30:03.630285 29478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 633ac952edaa441092651dfe4076752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:03.637166 29478 tablet_copy_client.cc:791] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: tablet copy: Starting download of 0 data blocks...
I20260811 07:30:03.637437 29478 tablet_copy_client.cc:655] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: tablet copy: Starting download of 1 WAL segments...
I20260811 07:30:03.639734 29478 tablet_copy_client.cc:531] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:30:03.641942 29478 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Bootstrap starting.
I20260811 07:30:03.647961 29478 log.cc:824] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:03.655565 29478 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:30:03.655953 29478 tablet_bootstrap.cc:492] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Bootstrap complete.
I20260811 07:30:03.656355 29478 ts_tablet_manager.cc:1397] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.003s
I20260811 07:30:03.658874 29478 raft_consensus.cc:348] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:03.659164 29478 raft_consensus.cc:729] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 898e097f4b574b1cafc4eb92bf41d3fe, State: Initialized, Role: FOLLOWER
I20260811 07:30:03.659655 29478 consensus_queue.cc:260] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "793c952b7c58481797abf762a6880361" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 34087 } } peers { permanent_uuid: "898e097f4b574b1cafc4eb92bf41d3fe" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 46115 } } peers { permanent_uuid: "ed108755da3d4fc283ad3792bd98fd38" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 34693 } }
I20260811 07:30:03.660662 29478 ts_tablet_manager.cc:1428] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20260811 07:30:03.661041 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.660732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:33017)
0811 07:30:03.660907 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:03.660966 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 07:30:03.661417 29116 tablet_copy_service.cc:342] P ed108755da3d4fc283ad3792bd98fd38: Request end of tablet copy session 898e097f4b574b1cafc4eb92bf41d3fe-633ac952edaa441092651dfe4076752e received from {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:44047
I20260811 07:30:03.661545 29116 tablet_copy_service.cc:433] P ed108755da3d4fc283ad3792bd98fd38: ending tablet copy session 898e097f4b574b1cafc4eb92bf41d3fe-633ac952edaa441092651dfe4076752e on tablet 633ac952edaa441092651dfe4076752e with peer 898e097f4b574b1cafc4eb92bf41d3fe
I20260811 07:30:03.661772 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:03.661570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:46719)
0811 07:30:03.661665 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:03.661721 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 07:30:04.100713 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:04.100225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:43993)
0811 07:30:04.100516 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:04.100590 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260811 07:30:04.100899 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:04.100475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:37251)
0811 07:30:04.100706 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:04.100758 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":73,"threads_started":1}
I20260811 07:30:04.143729 29487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:04.143400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:45183)
0811 07:30:04.143566 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:04.143632 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 07:30:04.143766 29407 raft_consensus.cc:1203] T 633ac952edaa441092651dfe4076752e P 898e097f4b574b1cafc4eb92bf41d3fe [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260811 07:30:04.144883 29482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:04.144584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:49737)
0811 07:30:04.144712 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:04.144770 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 07:30:05.102444 29490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:05.101908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:60461)
0811 07:30:05.102267 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:05.102341 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":85,"threads_started":1}
I20260811 07:30:05.145305 29491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:05.144691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:47769)
0811 07:30:05.145122 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:05.145186 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":220,"threads_started":1}
I20260811 07:30:05.146106 29492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:05.145677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:35603)
0811 07:30:05.145910 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:05.146008 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":73,"threads_started":1}
I20260811 07:30:06.103907 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:06.103406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:39087)
0811 07:30:06.103725 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:06.103793 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":89,"threads_started":1}
I20260811 07:30:06.147389 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:06.146804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:35571)
0811 07:30:06.147211 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:06.147286 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":101,"threads_started":1}
I20260811 07:30:06.147497 29499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:06.146913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:37055)
0811 07:30:06.147262 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:06.147381 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":76,"threads_started":1}
I20260811 07:30:07.105633 29501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:07.105125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:34739)
0811 07:30:07.105434 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:07.105504 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":87,"threads_started":1}
I20260811 07:30:07.149086 29502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:07.148483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:54861)
0811 07:30:07.148792 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:07.148988 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":117,"threads_started":1}
I20260811 07:30:07.149118 29503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:07.148535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:41089)
0811 07:30:07.148971 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:07.149029 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":72,"threads_started":1}
I20260811 07:30:07.149821 29502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:07.149613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:48949)
0811 07:30:07.149717 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:07.149763 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 07:30:08.107378 29504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:08.106793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:52421)
0811 07:30:08.107114 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:08.107182 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":86,"threads_started":1}
I20260811 07:30:08.150489 29505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:08.150024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:53183)
0811 07:30:08.150305 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:08.150361 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":118,"threads_started":1}
I20260811 07:30:08.150967 29506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:08.150467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:45377)
0811 07:30:08.150807 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:08.150857 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":98,"threads_started":1}
I20260811 07:30:09.108959 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:09.108432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:43461)
0811 07:30:09.108725 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:09.108791 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":84,"threads_started":1}
I20260811 07:30:09.152089 29508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:09.151496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:39627)
0811 07:30:09.151807 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:09.151892 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":91,"threads_started":1}
I20260811 07:30:09.152458 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:09.151784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:43517)
0811 07:30:09.152137 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:09.152293 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":91,"threads_started":1}
I20260811 07:30:10.110292 29513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:10.109822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:55069)
0811 07:30:10.110129 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:10.110194 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":102,"threads_started":1}
I20260811 07:30:10.153730 29514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:10.153280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:55847)
0811 07:30:10.153563 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:10.153627 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":101,"threads_started":1}
I20260811 07:30:10.154083 29515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:10.153497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:35631)
0811 07:30:10.153921 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:10.153997 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":118,"threads_started":1}
I20260811 07:30:11.111577 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:11.111127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:37351)
0811 07:30:11.111405 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:11.111472 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":92,"threads_started":1}
I20260811 07:30:11.155246 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:11.154599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:52207)
0811 07:30:11.154998 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:11.155089 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":93,"threads_started":1}
I20260811 07:30:11.155573 29518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:11.154962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:51559)
0811 07:30:11.155316 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:11.155454 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":85,"threads_started":1}
I20260811 07:30:12.113085 29519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:12.112554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:37357)
0811 07:30:12.112890 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:12.112985 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":91,"threads_started":1}
I20260811 07:30:12.156884 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:12.156265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:58371)
0811 07:30:12.156593 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:12.156675 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":80,"threads_started":1}
I20260811 07:30:12.157038 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:12.156451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:43159)
0811 07:30:12.156771 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:12.156913 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":81,"threads_started":1}
I20260811 07:30:13.114471 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:13.113941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:35025)
0811 07:30:13.114267 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:13.114332 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":105,"threads_started":1}
I20260811 07:30:13.158416 29526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:13.157857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:38245)
0811 07:30:13.158246 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:13.158308 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":185,"threads_started":1}
I20260811 07:30:13.158454 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:13.157854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:54099)
0811 07:30:13.158231 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:13.158315 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":93,"threads_started":1}
I20260811 07:30:14.116030 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:14.115419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:33989)
0811 07:30:14.115811 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:14.115893 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":103,"threads_started":1}
I20260811 07:30:14.159948 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:14.159431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:48219)
0811 07:30:14.159721 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:14.159784 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":106,"threads_started":1}
I20260811 07:30:14.159986 29528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:14.159411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:48657)
0811 07:30:14.159815 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:14.159888 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":109,"threads_started":1}
I20260811 07:30:15.117594 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:15.117080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:40511)
0811 07:30:15.117393 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:15.117490 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
I20260811 07:30:15.161530 29531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:15.161019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:46775)
0811 07:30:15.161329 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:15.161404 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":97,"threads_started":1}
I20260811 07:30:15.161562 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:15.161019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:33179)
0811 07:30:15.161409 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:15.161472 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":100,"threads_started":1}
I20260811 07:30:16.118983 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:16.118483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.2:53127)
0811 07:30:16.118779 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:16.118845 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":84,"threads_started":1}
I20260811 07:30:16.162999 29535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:16.162531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.3:47811)
0811 07:30:16.162830 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:16.162903 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":84,"threads_started":1}
I20260811 07:30:16.163085 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:16.162538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:42559 (local address 127.11.248.1:55139)
0811 07:30:16.162908 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:16.162969 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:42559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":113,"threads_started":1}
I20260811 07:30:16.701815 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 28961
I20260811 07:30:16.710438 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 29151
I20260811 07:30:16.718956 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 29312
2026-08-11T07:30:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20177 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:30:16 dist-test-slave-77v9 krb5kdc[29538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:30:16 dist-test-slave-77v9 krb5kdc[29538](info): set up 2 sockets
Aug 11 07:30:16 dist-test-slave-77v9 krb5kdc[29538](info): commencing operation
krb5kdc: starting...
W20260811 07:30:17.878585 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:30:17 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:30:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:30:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:30:18.025218 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35837
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:35837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:30:18.144203 29554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:18.144567 29554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:18.144655 29554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:18.148965 29554 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:30:18.149080 29554 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:30:18.149104 29554 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:30:18.149130 29554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:30:18.149176 29554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:18.149212 29554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:18.149250 29554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:30:18.149286 29554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:30:18.155153 29554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:35837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:18.156392 29554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:18.157500 29554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:18.167219 29561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:18.167168 29560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:18.167187 29565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:18.167243 29554 server_base.cc:1034] running on GCE node
I20260811 07:30:18.168023 29554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:18.169318 29554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:18.170521 29554 hybrid_clock.cc:648] HybridClock initialized: now 1786433418170509 us; error 29 us; skew 500 ppm
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:18.173507 29554 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:30:18.174516 29554 webserver.cc:460] Webserver started at http://127.11.248.62:46625/ using document root <none> and password file <none>
I20260811 07:30:18.175110 29554 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:18.175205 29554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:18.175446 29554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:30:18.177649 29554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "92448a0625254fdbbb4f6374c4fd530c"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "9550a177851ec457d412cdd155d70740"
server_key_iv: "f2c143af163150071112024ce255ea5e"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.178261 29554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "92448a0625254fdbbb4f6374c4fd530c"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "9550a177851ec457d412cdd155d70740"
server_key_iv: "f2c143af163150071112024ce255ea5e"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.182185 29554 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:30:18.184732 29575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.186146 29554 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 07:30:18.186309 29554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "92448a0625254fdbbb4f6374c4fd530c"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "9550a177851ec457d412cdd155d70740"
server_key_iv: "f2c143af163150071112024ce255ea5e"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.186446 29554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:18.204018 29554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:18.207314 29554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:18.207551 29554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:18.215390 29554 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:35837
I20260811 07:30:18.215718 29642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:35837 every 8 connection(s)
I20260811 07:30:18.216446 29554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:30:18.219702 29645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:18.223776 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 29554
I20260811 07:30:18.223960 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:30:18.224229 12256 external_mini_cluster.cc:1428] Setting key bf7a8b5daf34ee7dfe38e7fb7ffd2d6a
I20260811 07:30:18.226536 29645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap starting.
I20260811 07:30:18.229379 29645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:18.230261 29645 log.cc:824] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:18.232693 29645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: No bootstrap required, opened a new log
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:18.236898 29645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:18.237170 29645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:18.237264 29645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92448a0625254fdbbb4f6374c4fd530c, State: Initialized, Role: FOLLOWER
I20260811 07:30:18.237746 29645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:18.237921 29645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:30:18.238018 29645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:30:18.238142 29645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:18.239311 29645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:18.239673 29645 leader_election.cc:302] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92448a0625254fdbbb4f6374c4fd530c; no voters:
I20260811 07:30:18.239732 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:18.225888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52312 (local address 127.11.248.62:35837)
0811 07:30:18.226327 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:18.226344 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:18.226381 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:30:18.227100 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:18.227119 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:18.227460 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:18.227753 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:18.228787 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.229964 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.231146 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.231617 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.231746 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:18.234802 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:18.234808 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:18.234821 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:18.234867 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:18.236623 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:18.237112 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:18.237117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:18.237122 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:18.237276 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:18.237635 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:18.237638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:18.237639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:18.238115 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:18.238337 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:18.238629 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 07:30:18.238940 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":147,"threads_started":1}
I20260811 07:30:18.240099 29645 leader_election.cc:288] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:30:18.240221 29652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:30:18.240443 29652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 LEADER]: Becoming Leader. State: Replica: 92448a0625254fdbbb4f6374c4fd530c, State: Running, Role: LEADER
I20260811 07:30:18.240749 29652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:18.241518 29645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:30:18.242329 29653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92448a0625254fdbbb4f6374c4fd530c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } } }
I20260811 07:30:18.242447 29653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: This master's current role is: LEADER
I20260811 07:30:18.242852 29654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92448a0625254fdbbb4f6374c4fd530c. Latest consensus state: current_term: 1 leader_uuid: "92448a0625254fdbbb4f6374c4fd530c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } } }
I20260811 07:30:18.243026 29654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: This master's current role is: LEADER
I20260811 07:30:18.243799 29665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:30:18.246968 29665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:30:18.253284 29665 catalog_manager.cc:1347] Generated new cluster ID: 457982688f0a445496caba48ddd2f338
I20260811 07:30:18.253381 29665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:30:18.265689 29665 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:30:18.267055 29665 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:30:18.273267 29665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Generated new TSK 0
I20260811 07:30:18.274114 29665 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:30:18.317998 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35837
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:30:18.448469 29681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:18.448843 29681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:18.448895 29681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:18.453183 29681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:18.453275 29681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:18.453408 29681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:30:18.459312 29681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:18.460515 29681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:18.461661 29681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:18.472240 29691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:18.472394 29681 server_base.cc:1034] running on GCE node
W20260811 07:30:18.472254 29688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:18.472240 29687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:18.473004 29681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:18.473671 29681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:18.474870 29681 hybrid_clock.cc:648] HybridClock initialized: now 1786433418474849 us; error 33 us; skew 500 ppm
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:18.478013 29681 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:30:18.479085 29681 webserver.cc:460] Webserver started at http://127.11.248.1:33523/ using document root <none> and password file <none>
I20260811 07:30:18.479736 29681 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:18.479836 29681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:18.480093 29681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:30:18.482349 29681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "8db21062ca104f8cbafd7208694b7833"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "85facc67edaf299bc3e41a1270ad0221"
server_key_iv: "94bef1219ec7e4b0b3215adffbf71430"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.482956 29681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "8db21062ca104f8cbafd7208694b7833"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "85facc67edaf299bc3e41a1270ad0221"
server_key_iv: "94bef1219ec7e4b0b3215adffbf71430"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.486967 29681 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:30:18.489876 29700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.491596 29681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:18.491827 29681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "8db21062ca104f8cbafd7208694b7833"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "85facc67edaf299bc3e41a1270ad0221"
server_key_iv: "94bef1219ec7e4b0b3215adffbf71430"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.491974 29681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:18.511535 29681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:18.515417 29681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:18.515671 29681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:18.516353 29681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:18.517385 29681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:18.517462 29681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.517536 29681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:18.517580 29681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.527565 29681 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:36879
I20260811 07:30:18.527585 29828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:36879 every 8 connection(s)
I20260811 07:30:18.528554 29681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:30:18.537129 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 29681
I20260811 07:30:18.537302 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:30:18.537631 12256 external_mini_cluster.cc:1428] Setting key afd0e64dc78503b1e9ce30385a87280b
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:18.544005 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:18.530447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:42481 (local address 127.11.248.62:35837)
0811 07:30:18.530603 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:18.530608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:18.531767 (+ 1159us) server_negotiation.cc:407] Connection header received
0811 07:30:18.532673 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:18.532676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:18.532727 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:18.532882 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:18.534124 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.534737 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.536078 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.536329 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.536432 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:18.539612 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:18.539615 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:18.539617 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:18.539644 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:18.541489 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:18.542086 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:18.542090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:18.542095 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:18.542210 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:18.542688 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:18.542695 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:18.542700 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:18.542993 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:18.543115 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:18.543693 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 07:30:18.543836 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:30:18.545020 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:18.530899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:42481)
0811 07:30:18.531604 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:18.531657 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:18.532456 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:18.533034 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:18.533040 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:18.533449 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:18.533945 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:18.533959 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.534899 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.534903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:18.535942 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:18.535952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.536491 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.536495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:18.536647 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:18.537491 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:18.537508 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:18.539418 (+ 1910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:18.541631 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:18.541641 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:18.541664 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:18.541975 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:18.542322 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:18.542324 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:18.542325 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:18.542558 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:18.543102 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:18.543108 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:18.543417 (+ 309us) client_negotiation.cc:769] Sending connection context
0811 07:30:18.543644 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 07:30:18.544015 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":124,"threads_started":1}
I20260811 07:30:18.546413 29829 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35837
I20260811 07:30:18.546689 29829 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:18.547207 29829 heartbeater.cc:511] Master 127.11.248.62:35837 requested a full tablet report, sending...
I20260811 07:30:18.549033 29597 ts_manager.cc:194] Registered new tserver with Master: 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879)
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:30:18.550736 29597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:42481
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:30:18.572664 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35837
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:30:18.697088 29836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:18.697382 29836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:18.697427 29836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:18.702093 29836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:18.702179 29836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:18.702252 29836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:30:18.708635 29836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:18.710114 29836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:18.711452 29836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:18.723138 29842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:18.723158 29845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:18.723234 29836 server_base.cc:1034] running on GCE node
W20260811 07:30:18.723158 29843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:18.724045 29836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:18.724766 29836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:18.725998 29836 hybrid_clock.cc:648] HybridClock initialized: now 1786433418725964 us; error 52 us; skew 500 ppm
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:18.729312 29836 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:30:18.730312 29836 webserver.cc:460] Webserver started at http://127.11.248.2:35303/ using document root <none> and password file <none>
I20260811 07:30:18.730967 29836 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:18.731040 29836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:18.731307 29836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:30:18.733870 29836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "51f2345d9f3b4443b68ac5e45ddcaba8"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "dac034029ea48f5229f925fa375ec307"
server_key_iv: "5ba41d0be2f04892b946efb3871c88c8"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.734658 29836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "51f2345d9f3b4443b68ac5e45ddcaba8"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "dac034029ea48f5229f925fa375ec307"
server_key_iv: "5ba41d0be2f04892b946efb3871c88c8"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.740068 29836 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:30:18.743583 29853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.745313 29836 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:18.745463 29836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "51f2345d9f3b4443b68ac5e45ddcaba8"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "dac034029ea48f5229f925fa375ec307"
server_key_iv: "5ba41d0be2f04892b946efb3871c88c8"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.745611 29836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:18.760130 29836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:18.763597 29836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:18.763842 29836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:18.764485 29836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:18.765450 29836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:18.765509 29836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.765588 29836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:18.765640 29836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.775524 29836 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:40161
I20260811 07:30:18.775548 29980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:40161 every 8 connection(s)
I20260811 07:30:18.776502 29836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:30:18.781646 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 29836
I20260811 07:30:18.781759 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:30:18.782044 12256 external_mini_cluster.cc:1428] Setting key f0ea1e28b48ea57803d30fd01d74e92d
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:18.791873 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:18.778458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:56219 (local address 127.11.248.62:35837)
0811 07:30:18.778637 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:18.778643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:18.779765 (+ 1122us) server_negotiation.cc:407] Connection header received
0811 07:30:18.780725 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:18.780728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:18.780782 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:18.780949 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:18.782258 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.782817 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.784014 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.784251 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.784369 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:18.787339 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:18.787346 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:18.787352 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:18.787389 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:18.789347 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:18.789972 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:18.789979 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:18.789984 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:18.790091 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:18.790479 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:18.790484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:18.790489 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:18.790825 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:18.790958 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:18.791515 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 07:30:18.791661 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:30:18.792701 29983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:18.778806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:56219)
0811 07:30:18.779606 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:18.779655 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:18.780508 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:18.781102 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:18.781109 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:18.781492 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:18.782033 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:18.782047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.782971 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.782975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:18.783872 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:18.783882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:18.784424 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:18.784428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:18.784599 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:18.785283 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:18.785301 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:18.787129 (+ 1828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:18.789556 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:18.789562 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:18.789577 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:18.789862 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:18.790200 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:18.790202 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:18.790203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:18.790356 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:18.790955 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:18.790961 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:18.791229 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 07:30:18.791423 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 07:30:18.791710 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:30:18.794144 29981 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35837
I20260811 07:30:18.794462 29981 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:18.795070 29981 heartbeater.cc:511] Master 127.11.248.62:35837 requested a full tablet report, sending...
I20260811 07:30:18.796382 29597 ts_manager.cc:194] Registered new tserver with Master: 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:30:18.797335 29597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:56219
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:30:18.817474 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35837
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:30:18.934631 29986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:18.934932 29986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:18.934978 29986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:18.939065 29986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:18.939144 29986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:18.939206 29986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:30:18.946048 29986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:18.947429 29986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:18.948607 29986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:18.960222 29993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:18.960309 29997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:18.960265 29995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:18.960631 29986 server_base.cc:1034] running on GCE node
I20260811 07:30:18.961112 29986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:18.962152 29986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:18.963394 29986 hybrid_clock.cc:648] HybridClock initialized: now 1786433418963392 us; error 37 us; skew 500 ppm
Aug 11 07:30:18 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:18.966580 29986 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:30:18.967715 29986 webserver.cc:460] Webserver started at http://127.11.248.3:39051/ using document root <none> and password file <none>
I20260811 07:30:18.968397 29986 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:18.968497 29986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:18.968751 29986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:30:18.970999 29986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "a3437e8ac5f04ed39b0214020abebe07"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "eeefb9e1dd1d0f12eab0cff30ce0f570"
server_key_iv: "3f01b7d8ce9c7906eb68bf29c3512b37"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.971598 29986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "a3437e8ac5f04ed39b0214020abebe07"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "eeefb9e1dd1d0f12eab0cff30ce0f570"
server_key_iv: "3f01b7d8ce9c7906eb68bf29c3512b37"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.976536 29986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:30:18.979364 30007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:18.980945 29986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:18.981101 29986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "a3437e8ac5f04ed39b0214020abebe07"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "eeefb9e1dd1d0f12eab0cff30ce0f570"
server_key_iv: "3f01b7d8ce9c7906eb68bf29c3512b37"
server_key_version: "encryptionkey@0"
I20260811 07:30:18.981263 29986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:19.018715 29986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:19.022125 29986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:19.022364 29986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:19.023044 29986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:19.023963 29986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:19.024040 29986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:19.024116 29986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:19.024163 29986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:19.033772 29986 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:38295
I20260811 07:30:19.033797 30131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:38295 every 8 connection(s)
I20260811 07:30:19.034754 29986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:30:19.037086 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 29986
I20260811 07:30:19.037246 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:30:19.037614 12256 external_mini_cluster.cc:1428] Setting key c4c593cbf7372538c09ae5d926cadf5a
Aug 11 07:30:19 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433418, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:19.049832 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.036693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:42721 (local address 127.11.248.62:35837)
0811 07:30:19.036915 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.036920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.038419 (+ 1499us) server_negotiation.cc:407] Connection header received
0811 07:30:19.039151 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.039155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.039214 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.039298 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:19.040621 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.041235 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.042574 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.042815 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.042963 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.045868 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:19.045872 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:19.045874 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:19.045909 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:19.047452 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:19.048031 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:19.048034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:19.048035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:19.048120 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:19.048491 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:19.048494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:19.048496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:19.048701 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:19.048814 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.049442 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.049586 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:30:19.050971 30134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.037170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:42721)
0811 07:30:19.038034 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.038081 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:19.038940 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:19.039474 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:19.039480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:19.039855 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:19.040470 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.040485 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.041381 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.041383 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.042434 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.042444 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.042985 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.042989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.043183 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.043898 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:19.043917 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:19.045635 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:19.047589 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:19.047596 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:19.047615 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:19.047902 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:19.048216 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:19.048220 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:19.048222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:19.048377 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:19.048834 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:19.048842 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:19.049178 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 07:30:19.049397 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 07:30:19.049909 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":139,"threads_started":1}
I20260811 07:30:19.052251 30132 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35837
I20260811 07:30:19.052548 30132 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:19.053121 30132 heartbeater.cc:511] Master 127.11.248.62:35837 requested a full tablet report, sending...
I20260811 07:30:19.054165 29597 ts_manager.cc:194] Registered new tserver with Master: a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295)
I20260811 07:30:19.054786 29597 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:42721
I20260811 07:30:19.064520 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:30:19.074527 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.066713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41076 (local address 127.11.248.62:35837)
0811 07:30:19.066855 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.066859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.067094 (+ 235us) server_negotiation.cc:407] Connection header received
0811 07:30:19.067201 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.067203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.067247 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.067322 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:19.068058 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.068589 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.069518 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.069762 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.069845 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.071450 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:19.071454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:19.071456 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:19.071483 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:19.072911 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:19.073315 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:19.073318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:19.073319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:19.073398 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:19.073654 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:19.073656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:19.073657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:19.073888 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:19.073995 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.074280 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.074401 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:30:19.078759 29597 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:30:19.082033 29597 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:30:19.097800 30149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.091754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35650 (local address 127.11.248.2:40161)
0811 07:30:19.092762 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.092773 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.092793 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:30:19.092922 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.092928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.093112 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.093256 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:19.093634 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.094365 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.096032 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.097006 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.097129 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.097293 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.097522 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.097628 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":907,"thread_start_us":122,"threads_started":1}
I20260811 07:30:19.097793 30150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.091392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40161 (local address 127.0.0.1:35650)
0811 07:30:19.092254 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.092313 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:19.092454 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:19.093238 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:19.093241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:19.093258 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:19.093491 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.093498 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.094503 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.094510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.095890 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.095901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.097131 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.097135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.097265 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.097350 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 07:30:19.097485 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:30:19.097640 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":132,"spinlock_wait_cycles":1280,"thread_start_us":106,"threads_started":1}
I20260811 07:30:19.097816 30145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.091961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:38295 (local address 127.0.0.1:48218)
0811 07:30:19.092254 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.092309 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:19.092454 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:19.093213 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:19.093215 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:19.093227 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:19.093491 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.093498 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.094898 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.094901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.096097 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.096104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.097264 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.097268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.097382 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.097407 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:30:19.097463 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:30:19.097642 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":193,"spinlock_wait_cycles":3328,"thread_start_us":97,"threads_started":1}
I20260811 07:30:19.098353 30151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.092157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.11.248.3:38295)
0811 07:30:19.092731 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.092744 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.092770 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:30:19.092877 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.092884 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.093066 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.093433 (+ 367us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:19.093591 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.094760 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.096209 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.097118 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.097888 (+ 770us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.098066 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.098117 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.098214 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":163,"threads_started":1}
I20260811 07:30:19.099450 30147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.091368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43630 (local address 127.11.248.1:36879)
0811 07:30:19.091789 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.091797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.092412 (+ 615us) server_negotiation.cc:407] Connection header received
0811 07:30:19.092638 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.092644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.092892 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.093041 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:19.093611 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.094760 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.096280 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.097118 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.097240 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.097388 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.097746 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.097858 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":88,"threads_started":1}
I20260811 07:30:19.099823 30148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.091197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36879 (local address 127.0.0.1:43630)
0811 07:30:19.092254 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.092309 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:19.092475 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:19.093183 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:19.093192 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:19.093217 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:19.093458 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.093466 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.094926 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.094929 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.096166 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.096179 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.097461 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.097465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.097579 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.097606 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:30:19.099613 (+ 2007us) client_negotiation.cc:240] Negotiation successful
0811 07:30:19.099700 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":879,"mutex_wait_us":78,"thread_start_us":111,"threads_started":1}
I20260811 07:30:19.101233 29908 tablet_service.cc:1467] Processing CreateTablet for tablet 133ea04f9a484334a88dfeb3d907b70e (DEFAULT_TABLE table=test-table [id=b178f4b3d89844c0a0c3090adc76f7e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:19.102293 29908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133ea04f9a484334a88dfeb3d907b70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:19.102321 29755 tablet_service.cc:1467] Processing CreateTablet for tablet 133ea04f9a484334a88dfeb3d907b70e (DEFAULT_TABLE table=test-table [id=b178f4b3d89844c0a0c3090adc76f7e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:19.103303 29755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133ea04f9a484334a88dfeb3d907b70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:19.107200 30057 tablet_service.cc:1467] Processing CreateTablet for tablet 133ea04f9a484334a88dfeb3d907b70e (DEFAULT_TABLE table=test-table [id=b178f4b3d89844c0a0c3090adc76f7e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:19.108343 30057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133ea04f9a484334a88dfeb3d907b70e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:19.109511 30153 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Bootstrap starting.
I20260811 07:30:19.110746 30154 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Bootstrap starting.
I20260811 07:30:19.112236 30153 tablet_bootstrap.cc:654] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:19.113086 30153 log.cc:824] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:19.113336 30154 tablet_bootstrap.cc:654] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:19.114169 30154 log.cc:824] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:19.115170 30153 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: No bootstrap required, opened a new log
I20260811 07:30:19.115382 30153 ts_tablet_manager.cc:1397] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:30:19.116169 30154 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: No bootstrap required, opened a new log
I20260811 07:30:19.116355 30154 ts_tablet_manager.cc:1397] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260811 07:30:19.117523 30158 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Bootstrap starting.
I20260811 07:30:19.119494 30153 raft_consensus.cc:348] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.119738 30153 raft_consensus.cc:374] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:19.119793 30153 raft_consensus.cc:729] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db21062ca104f8cbafd7208694b7833, State: Initialized, Role: FOLLOWER
I20260811 07:30:19.120163 30158 tablet_bootstrap.cc:654] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:19.120257 30153 consensus_queue.cc:260] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.120270 30154 raft_consensus.cc:348] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.120563 30154 raft_consensus.cc:374] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:19.120623 30154 raft_consensus.cc:729] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f2345d9f3b4443b68ac5e45ddcaba8, State: Initialized, Role: FOLLOWER
I20260811 07:30:19.121069 29829 heartbeater.cc:503] Master 127.11.248.62:35837 was elected leader, sending a full tablet report...
I20260811 07:30:19.121099 30158 log.cc:824] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:19.121364 30153 ts_tablet_manager.cc:1428] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 07:30:19.121702 30154 consensus_queue.cc:260] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.122370 29981 heartbeater.cc:503] Master 127.11.248.62:35837 was elected leader, sending a full tablet report...
I20260811 07:30:19.122622 30154 ts_tablet_manager.cc:1428] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:30:19.124547 30158 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: No bootstrap required, opened a new log
I20260811 07:30:19.124750 30158 ts_tablet_manager.cc:1397] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:30:19.127866 30158 raft_consensus.cc:348] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.128125 30158 raft_consensus.cc:374] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:19.128211 30158 raft_consensus.cc:729] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3437e8ac5f04ed39b0214020abebe07, State: Initialized, Role: FOLLOWER
I20260811 07:30:19.128604 30158 consensus_queue.cc:260] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.129299 30132 heartbeater.cc:503] Master 127.11.248.62:35837 was elected leader, sending a full tablet report...
I20260811 07:30:19.129573 30158 ts_tablet_manager.cc:1428] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260811 07:30:19.277830 29982 tablet.cc:2369] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:30:19.280043 29831 tablet.cc:2369] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:30:19.285771 30133 tablet.cc:2369] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:30:19.303570 30159 raft_consensus.cc:482] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:30:19.303834 30159 raft_consensus.cc:504] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.305124 30159 leader_election.cc:288] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161), a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295)
I20260811 07:30:19.309397 30164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.305361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40161 (local address 127.11.248.1:36731)
0811 07:30:19.305837 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.305852 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:19.306015 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:19.306285 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:19.306289 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:19.306304 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:19.306451 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.306467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.307316 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.307322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.308203 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.308212 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.308920 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.308924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.309024 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.309060 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:30:19.309159 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 07:30:19.309234 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":23,"thread_start_us":152,"threads_started":1}
I20260811 07:30:19.309371 30149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.305614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:36731 (local address 127.11.248.2:40161)
0811 07:30:19.305754 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.305760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.305994 (+ 234us) server_negotiation.cc:407] Connection header received
0811 07:30:19.306127 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.306132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.306186 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.306276 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:19.306577 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.307203 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.308335 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.308747 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.308920 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.308976 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.309174 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.309247 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:30:19.309650 30151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.305656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:54041 (local address 127.11.248.3:38295)
0811 07:30:19.305811 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.305815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.306138 (+ 323us) server_negotiation.cc:407] Connection header received
0811 07:30:19.306328 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.306331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.306372 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.306482 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:19.306844 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.307392 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.308557 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.309050 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.309185 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.309254 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.309453 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.309526 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:30:19.309674 30163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.305466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:38295 (local address 127.11.248.1:54041)
0811 07:30:19.306040 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.306058 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:19.306182 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:19.306492 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:19.306495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:19.306513 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:19.306652 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.306658 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.307513 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.307520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.308410 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:19.308420 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.309178 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.309182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:19.309303 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.309327 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:30:19.309435 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:30:19.309508 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":3,"thread_start_us":122,"threads_started":1}
I20260811 07:30:19.310185 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ea04f9a484334a88dfeb3d907b70e" candidate_uuid: "8db21062ca104f8cbafd7208694b7833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" is_pre_election: true
I20260811 07:30:19.310230 30081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ea04f9a484334a88dfeb3d907b70e" candidate_uuid: "8db21062ca104f8cbafd7208694b7833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3437e8ac5f04ed39b0214020abebe07" is_pre_election: true
I20260811 07:30:19.310528 29930 raft_consensus.cc:2454] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8db21062ca104f8cbafd7208694b7833 in term 0.
I20260811 07:30:19.310528 30081 raft_consensus.cc:2454] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8db21062ca104f8cbafd7208694b7833 in term 0.
I20260811 07:30:19.311033 29701 leader_election.cc:302] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 51f2345d9f3b4443b68ac5e45ddcaba8, 8db21062ca104f8cbafd7208694b7833, a3437e8ac5f04ed39b0214020abebe07; no voters:
I20260811 07:30:19.311305 30159 raft_consensus.cc:2781] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:30:19.311400 30159 raft_consensus.cc:482] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:30:19.311453 30159 raft_consensus.cc:3037] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:19.312507 30159 raft_consensus.cc:504] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.312911 30159 leader_election.cc:288] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 1 election: Requested vote from peers 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161), a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295)
I20260811 07:30:19.313263 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ea04f9a484334a88dfeb3d907b70e" candidate_uuid: "8db21062ca104f8cbafd7208694b7833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8"
I20260811 07:30:19.313392 29930 raft_consensus.cc:3037] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:19.313391 30081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ea04f9a484334a88dfeb3d907b70e" candidate_uuid: "8db21062ca104f8cbafd7208694b7833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3437e8ac5f04ed39b0214020abebe07"
I20260811 07:30:19.313575 30081 raft_consensus.cc:3037] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:19.314520 29930 raft_consensus.cc:2454] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8db21062ca104f8cbafd7208694b7833 in term 1.
I20260811 07:30:19.314841 30081 raft_consensus.cc:2454] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8db21062ca104f8cbafd7208694b7833 in term 1.
I20260811 07:30:19.314862 29701 leader_election.cc:302] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f2345d9f3b4443b68ac5e45ddcaba8, 8db21062ca104f8cbafd7208694b7833; no voters:
I20260811 07:30:19.315054 30159 raft_consensus.cc:2781] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:30:19.315369 30159 raft_consensus.cc:686] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 LEADER]: Becoming Leader. State: Replica: 8db21062ca104f8cbafd7208694b7833, State: Running, Role: LEADER
I20260811 07:30:19.315774 30159 consensus_queue.cc:237] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:19.319525 29596 catalog_manager.cc:5495] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8db21062ca104f8cbafd7208694b7833 (127.11.248.1). New cstate: current_term: 1 leader_uuid: "8db21062ca104f8cbafd7208694b7833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } health_report { overall_health: UNKNOWN } } }
I20260811 07:30:19.338039 30147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.333979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43646 (local address 127.11.248.1:36879)
0811 07:30:19.334130 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:19.334136 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:19.334153 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:30:19.334372 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:19.334374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:19.334439 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:19.334568 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:30:19.334855 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.335421 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.336404 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:19.336642 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:19.336766 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:19.337146 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:30:19.337607 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:30:19.337760 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:19.337805 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 07:30:19.337870 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:30:19.344513 29930 raft_consensus.cc:1261] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Refusing update from remote peer 8db21062ca104f8cbafd7208694b7833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:30:19.344513 30081 raft_consensus.cc:1261] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Refusing update from remote peer 8db21062ca104f8cbafd7208694b7833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:30:19.345379 30165 consensus_queue.cc:1035] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:30:19.345608 30159 consensus_queue.cc:1035] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:30:19.365675 29596 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:30:19.365916 29596 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:30:19.368954 29596 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Sending DeleteTablet for 3 replicas of tablet 133ea04f9a484334a88dfeb3d907b70e
I20260811 07:30:19.369930 29755 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ea04f9a484334a88dfeb3d907b70e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:43630
I20260811 07:30:19.369946 30057 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ea04f9a484334a88dfeb3d907b70e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:48218
I20260811 07:30:19.369946 29908 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ea04f9a484334a88dfeb3d907b70e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:35650
I20260811 07:30:19.370954 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 29681
I20260811 07:30:19.370965 30182 tablet_replica.cc:330] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: stopping tablet replica
I20260811 07:30:19.371313 30182 raft_consensus.cc:2229] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:30:19.371645 30182 raft_consensus.cc:2258] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:19.371994 30181 tablet_replica.cc:330] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: stopping tablet replica
I20260811 07:30:19.372254 30181 raft_consensus.cc:2229] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:30:19.372478 30181 raft_consensus.cc:2258] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:19.374557 30181 ts_tablet_manager.cc:1905] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:19.377681 30181 ts_tablet_manager.cc:1918] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:19.377779 30181 log.cc:1196] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/133ea04f9a484334a88dfeb3d907b70e
I20260811 07:30:19.378126 30181 ts_tablet_manager.cc:1939] T 133ea04f9a484334a88dfeb3d907b70e P a3437e8ac5f04ed39b0214020abebe07: Deleting consensus metadata
I20260811 07:30:19.379550 30182 ts_tablet_manager.cc:1905] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:19.379642 29584 catalog_manager.cc:4841] TS a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): tablet 133ea04f9a484334a88dfeb3d907b70e (table test-table [id=b178f4b3d89844c0a0c3090adc76f7e9]) successfully deleted
I20260811 07:30:19.383059 30182 ts_tablet_manager.cc:1918] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:19.383188 30182 log.cc:1196] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/133ea04f9a484334a88dfeb3d907b70e
I20260811 07:30:19.383564 30182 ts_tablet_manager.cc:1939] T 133ea04f9a484334a88dfeb3d907b70e P 51f2345d9f3b4443b68ac5e45ddcaba8: Deleting consensus metadata
I20260811 07:30:19.385110 29576 catalog_manager.cc:4841] TS 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): tablet 133ea04f9a484334a88dfeb3d907b70e (table test-table [id=b178f4b3d89844c0a0c3090adc76f7e9]) successfully deleted
I20260811 07:30:19.386060 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 29836
W20260811 07:30:19.386108 29584 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:36879 (error 108)
I20260811 07:30:19.390959 30148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:19.390603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36879 (local address 127.0.0.1:43652)
0811 07:30:19.390740 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:19.390843 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:36879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:30:19.391187 29584 catalog_manager.cc:4584] TS 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 133ea04f9a484334a88dfeb3d907b70e: Network error: Client connection negotiation failed: client connection to 127.11.248.1:36879: connect: Connection refused (error 111)
I20260811 07:30:19.395311 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 29986
I20260811 07:30:19.404090 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 29554
I20260811 07:30:39.413650 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35837
--webserver_interface=127.11.248.62
--webserver_port=46625
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:35837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:30:39.546200 30185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:39.546589 30185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:39.546671 30185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:39.551110 30185 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:30:39.551225 30185 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:30:39.551256 30185 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:30:39.551280 30185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:30:39.551330 30185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:39.551374 30185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:39.551430 30185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:30:39.551471 30185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:30:39.557494 30185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:35837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=46625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:39.558732 30185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:39.559873 30185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:39.576071 30196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:39.576172 30185 server_base.cc:1034] running on GCE node
W20260811 07:30:39.576077 30197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:39.576081 30199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:39.576998 30185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:39.578424 30185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:39.579742 30185 hybrid_clock.cc:648] HybridClock initialized: now 1786433439579709 us; error 61 us; skew 500 ppm
Aug 11 07:30:39 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:39.588765 30185 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:30:39.590018 30185 webserver.cc:460] Webserver started at http://127.11.248.62:46625/ using document root <none> and password file <none>
I20260811 07:30:39.590646 30185 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:39.590730 30185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:39.595381 30185 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:30:39.597896 30206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:39.599380 30185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:39.599529 30185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "92448a0625254fdbbb4f6374c4fd530c"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "9550a177851ec457d412cdd155d70740"
server_key_iv: "f2c143af163150071112024ce255ea5e"
server_key_version: "encryptionkey@0"
I20260811 07:30:39.600222 30185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:39.634173 30185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:39.638244 30185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:39.638466 30185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:39.648111 30185 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:35837
I20260811 07:30:39.648480 30265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:35837 every 8 connection(s)
I20260811 07:30:39.649502 30185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:30:39.654860 30266 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:30:39.654886 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 30185
I20260811 07:30:39.655452 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:36879
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:35837
--webserver_port=33523
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:30:39.657739 30266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap starting.
I20260811 07:30:39.683660 30266 log.cc:824] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:39.695763 30266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:30:39.696333 30266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap complete.
I20260811 07:30:39.702241 30266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:39.702862 30266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92448a0625254fdbbb4f6374c4fd530c, State: Initialized, Role: FOLLOWER
I20260811 07:30:39.703550 30266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:39.703722 30266 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:30:39.703804 30266 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:30:39.703936 30266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:30:39.706913 30266 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:39.707363 30266 leader_election.cc:302] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92448a0625254fdbbb4f6374c4fd530c; no voters:
I20260811 07:30:39.707762 30266 leader_election.cc:288] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:30:39.708019 30273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:30:39.708477 30273 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 LEADER]: Becoming Leader. State: Replica: 92448a0625254fdbbb4f6374c4fd530c, State: Running, Role: LEADER
I20260811 07:30:39.708884 30273 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:30:39.709229 30266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:30:39.710772 30275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92448a0625254fdbbb4f6374c4fd530c. Latest consensus state: current_term: 2 leader_uuid: "92448a0625254fdbbb4f6374c4fd530c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } } }
I20260811 07:30:39.710772 30274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "92448a0625254fdbbb4f6374c4fd530c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } } }
I20260811 07:30:39.710969 30274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: This master's current role is: LEADER
I20260811 07:30:39.710970 30275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: This master's current role is: LEADER
I20260811 07:30:39.715389 30289 catalog_manager.cc:1259] Loaded cluster ID: 457982688f0a445496caba48ddd2f338
I20260811 07:30:39.715492 30289 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: loading cluster ID for follower catalog manager: success
I20260811 07:30:39.718210 30289 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: acquiring CA information for follower catalog manager: success
I20260811 07:30:39.719903 30289 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:30:39.720139 30288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:30:39.723551 30288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:30:39.724148 30288 catalog_manager.cc:1259] Loaded cluster ID: 457982688f0a445496caba48ddd2f338
I20260811 07:30:39.724232 30288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:30:39.725015 30288 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:30:39.725528 30288 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Loaded TSK: 0
I20260811 07:30:39.737413 30288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Generated new TSK 1
I20260811 07:30:39.737749 30288 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:30:39.802357 30271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:39.802683 30271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:39.802732 30271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:39.807475 30271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:39.807569 30271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:39.807634 30271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:30:39.814004 30271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:36879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=33523
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:39.815235 30271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:39.816335 30271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:39.828760 30297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:39.828760 30301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:39.828787 30298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:39.829231 30271 server_base.cc:1034] running on GCE node
I20260811 07:30:39.829766 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:39.830710 30271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:39.831938 30271 hybrid_clock.cc:648] HybridClock initialized: now 1786433439831905 us; error 61 us; skew 500 ppm
Aug 11 07:30:39 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:39.835397 30271 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:30:39.836710 30271 webserver.cc:460] Webserver started at http://127.11.248.1:33523/ using document root <none> and password file <none>
I20260811 07:30:39.837577 30271 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:39.837713 30271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:39.843797 30271 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 07:30:39.847153 30308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:39.849037 30271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:39.849218 30271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "8db21062ca104f8cbafd7208694b7833"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "85facc67edaf299bc3e41a1270ad0221"
server_key_iv: "94bef1219ec7e4b0b3215adffbf71430"
server_key_version: "encryptionkey@0"
I20260811 07:30:39.850102 30271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:39.873588 30271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:39.877887 30271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:39.878151 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:39.878974 30271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:39.880384 30315 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:30:39.885325 30271 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:30:39.885419 30271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 07:30:39.885517 30271 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:30:39.887590 30271 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:30:39.887679 30271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 07:30:39.887969 30315 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Bootstrap starting.
I20260811 07:30:39.900979 30271 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:36879
I20260811 07:30:39.901026 30439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:36879 every 8 connection(s)
I20260811 07:30:39.902594 30271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:30:39.906493 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 30271
I20260811 07:30:39.907158 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:40161
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:35837
--webserver_port=35303
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:30:39.912267 30315 log.cc:824] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:30:39 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:39.921378 30315 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:30:39.921957 30315 tablet_bootstrap.cc:492] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Bootstrap complete.
I20260811 07:30:39.923410 30315 ts_tablet_manager.cc:1397] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Time spent bootstrapping tablet: real 0.036s user 0.029s sys 0.004s
I20260811 07:30:39.925129 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:39.905353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:42735 (local address 127.11.248.62:35837)
0811 07:30:39.905824 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:39.905853 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:39.907409 (+ 1556us) server_negotiation.cc:407] Connection header received
0811 07:30:39.907686 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:39.907696 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:39.908030 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:39.908385 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:39.910038 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.911727 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.913879 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.914619 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.914824 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:39.918461 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:39.918468 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:39.918485 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:39.918526 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:39.920950 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:39.921739 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:39.921751 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:39.921759 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:39.921959 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:39.922416 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:39.922423 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:39.922428 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:39.922976 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:39.923106 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:39.923896 (+ 790us) server_negotiation.cc:299] Negotiation successful
0811 07:30:39.924240 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":153,"threads_started":1}
I20260811 07:30:39.925135 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:39.905364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:42735)
0811 07:30:39.906035 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:39.906091 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:39.907064 (+ 973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:39.908460 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:39.908468 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:39.909036 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:39.909775 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:39.909800 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.911965 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.911972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:39.913670 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:39.913692 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.914828 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.914835 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:39.915095 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:39.915901 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:39.915928 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:39.918171 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:39.921112 (+ 2941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:39.921119 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:39.921134 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:39.921528 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:39.922102 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:39.922105 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:39.922107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:39.922291 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:39.923168 (+ 877us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:39.923174 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:39.923496 (+ 322us) client_negotiation.cc:769] Sending connection context
0811 07:30:39.923706 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 07:30:39.924086 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":170,"threads_started":1}
I20260811 07:30:39.926671 30315 raft_consensus.cc:348] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:39.927253 30315 raft_consensus.cc:729] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db21062ca104f8cbafd7208694b7833, State: Initialized, Role: FOLLOWER
I20260811 07:30:39.927838 30315 consensus_queue.cc:260] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } }
I20260811 07:30:39.928121 30440 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35837
I20260811 07:30:39.928395 30440 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:39.929040 30440 heartbeater.cc:511] Master 127.11.248.62:35837 requested a full tablet report, sending...
I20260811 07:30:39.929078 30315 ts_tablet_manager.cc:1428] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260811 07:30:39.932156 30228 ts_manager.cc:194] Registered new tserver with Master: 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879)
I20260811 07:30:39.936745 30228 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:42735
I20260811 07:30:39.939951 30440 heartbeater.cc:503] Master 127.11.248.62:35837 was elected leader, sending a full tablet report...
Aug 11 07:30:39 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.1@KRBTEST.COM
I20260811 07:30:39.948959 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:39.936145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36879 (local address 127.0.0.1:35136)
0811 07:30:39.937275 (+ 1130us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:39.937321 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:39.937541 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:39.938111 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:39.938118 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:39.938607 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:39.938753 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:39.938761 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.939873 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.939878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:39.940887 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:39.940898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.941664 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.941668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:39.941807 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:39.942502 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:39.942514 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:39.944413 (+ 1899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:39.946893 (+ 2480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:39.946906 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:39.946910 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:39.947211 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:39.947567 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:39.947570 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:39.947571 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:39.947666 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:39.948253 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:39.948258 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:39.948393 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 07:30:39.948521 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 07:30:39.948711 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"thread_start_us":198,"threads_started":1}
I20260811 07:30:39.949050 30449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:39.936252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35136 (local address 127.11.248.1:36879)
0811 07:30:39.936790 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:39.936803 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:39.937464 (+ 661us) server_negotiation.cc:407] Connection header received
0811 07:30:39.937738 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:39.937743 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:39.937933 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:39.938110 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:39.938913 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.939721 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.941015 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:39.941514 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:39.941635 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:39.944600 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:39.944616 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:39.944631 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:39.944663 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:39.946728 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:39.947343 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:39.947349 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:39.947352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:39.947454 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:39.947764 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:39.947768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:39.947769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:39.948132 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:39.948267 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:39.948642 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 07:30:39.948870 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":131,"threads_started":1}
I20260811 07:30:39.950412 30364 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ea04f9a484334a88dfeb3d907b70e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:35136
I20260811 07:30:39.951525 30450 tablet_replica.cc:330] stopping tablet replica
I20260811 07:30:39.951910 30450 raft_consensus.cc:2229] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:30:39.952196 30450 raft_consensus.cc:2258] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:39.953416 30450 ts_tablet_manager.cc:1905] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:39.957793 30450 ts_tablet_manager.cc:1918] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:39.957944 30450 log.cc:1196] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal/wals/133ea04f9a484334a88dfeb3d907b70e
I20260811 07:30:39.958307 30450 ts_tablet_manager.cc:1939] T 133ea04f9a484334a88dfeb3d907b70e P 8db21062ca104f8cbafd7208694b7833: Deleting consensus metadata
I20260811 07:30:39.960230 30211 catalog_manager.cc:4841] TS 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879): tablet 133ea04f9a484334a88dfeb3d907b70e (table test-table [id=b178f4b3d89844c0a0c3090adc76f7e9]) successfully deleted
W20260811 07:30:40.041421 30444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:40.041764 30444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:40.041812 30444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:40.046262 30444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:40.046355 30444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:40.046420 30444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:30:40.052317 30444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:40161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=35303
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:40.053646 30444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:40.054800 30444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:40.065879 30456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:40.066186 30444 server_base.cc:1034] running on GCE node
W20260811 07:30:40.065834 30455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:40.065799 30458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:40.066883 30444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:40.067639 30444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:40.068912 30444 hybrid_clock.cc:648] HybridClock initialized: now 1786433440068887 us; error 41 us; skew 500 ppm
Aug 11 07:30:40 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433440, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:40.073230 30444 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:30:40.074383 30444 webserver.cc:460] Webserver started at http://127.11.248.2:35303/ using document root <none> and password file <none>
I20260811 07:30:40.075030 30444 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:40.075156 30444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:40.079624 30444 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:30:40.082191 30466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:40.083714 30444 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:30:40.083931 30444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "51f2345d9f3b4443b68ac5e45ddcaba8"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "dac034029ea48f5229f925fa375ec307"
server_key_iv: "5ba41d0be2f04892b946efb3871c88c8"
server_key_version: "encryptionkey@0"
I20260811 07:30:40.084573 30444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:40.103168 30444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:40.107112 30444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:40.107359 30444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:40.108029 30444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:40.109030 30444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:40.109105 30444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:40.109179 30444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:40.109223 30444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:40.119589 30444 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:40161
I20260811 07:30:40.119643 30607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:40161 every 8 connection(s)
I20260811 07:30:40.120730 30444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:30:40.127334 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 30444
I20260811 07:30:40.127898 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:38295
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:35837
--webserver_port=39051
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:30:40 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433440, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:40.137176 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.123087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:48163 (local address 127.11.248.62:35837)
0811 07:30:40.123249 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.123253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.124400 (+ 1147us) server_negotiation.cc:407] Connection header received
0811 07:30:40.125464 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.125467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.125540 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.125655 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:40.126966 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.127611 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.128955 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.129222 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.129353 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.132632 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:40.132636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:40.132638 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:40.132668 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:40.134622 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.135271 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.135277 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.135282 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.135380 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.135841 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.135844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.135845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.136055 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:40.136172 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.136794 (+ 622us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.136993 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:30:40.138144 30610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.123529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:48163)
0811 07:30:40.124227 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.124273 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:40.125222 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:40.125846 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:40.125853 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:40.126245 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:40.126781 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.126795 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.127752 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.127760 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.128780 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.128791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.129401 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.129405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.129597 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.130356 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:40.130383 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:40.132388 (+ 2005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:40.134788 (+ 2400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:40.134796 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:40.134816 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:40.135136 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:40.135484 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:40.135488 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:40.135490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:40.135665 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:40.136174 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:40.136184 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:40.136519 (+ 335us) client_negotiation.cc:769] Sending connection context
0811 07:30:40.136739 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 07:30:40.137179 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":120,"threads_started":1}
I20260811 07:30:40.139865 30608 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35837
I20260811 07:30:40.140161 30608 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:40.140726 30608 heartbeater.cc:511] Master 127.11.248.62:35837 requested a full tablet report, sending...
I20260811 07:30:40.142294 30228 ts_manager.cc:194] Registered new tserver with Master: 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
I20260811 07:30:40.142927 30228 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:48163
W20260811 07:30:40.253909 30611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:30:40.254257 30611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:30:40.254338 30611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:30:40.258776 30611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:30:40.258889 30611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:30:40.258983 30611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:30:40.264748 30611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:38295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=39051
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:30:40.266032 30611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:30:40.267342 30611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:30:40.277719 30620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:40.277854 30617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:30:40.277719 30616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:30:40.278158 30611 server_base.cc:1034] running on GCE node
I20260811 07:30:40.278621 30611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:30:40.279317 30611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:30:40.280496 30611 hybrid_clock.cc:648] HybridClock initialized: now 1786433440280478 us; error 32 us; skew 500 ppm
Aug 11 07:30:40 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433440, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:30:40.283689 30611 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:30:40.284713 30611 webserver.cc:460] Webserver started at http://127.11.248.3:39051/ using document root <none> and password file <none>
I20260811 07:30:40.285359 30611 fs_manager.cc:359] Metadata directory not provided
I20260811 07:30:40.285454 30611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:30:40.289851 30611 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:30:40.292290 30628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:40.293792 30611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:30:40.293963 30611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "a3437e8ac5f04ed39b0214020abebe07"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "eeefb9e1dd1d0f12eab0cff30ce0f570"
server_key_iv: "3f01b7d8ce9c7906eb68bf29c3512b37"
server_key_version: "encryptionkey@0"
I20260811 07:30:40.294554 30611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:30:40.323158 30611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:30:40.326601 30611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:30:40.326776 30611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:30:40.327383 30611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:30:40.328218 30611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:30:40.328270 30611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:40.328311 30611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:30:40.328373 30611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:30:40.338434 30611 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:38295
I20260811 07:30:40.338454 30764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:38295 every 8 connection(s)
I20260811 07:30:40.339548 30611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:30:40.348918 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 30611
Aug 11 07:30:40 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433440, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:30:40.356863 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.341710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:53839 (local address 127.11.248.62:35837)
0811 07:30:40.341904 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.341908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.343270 (+ 1362us) server_negotiation.cc:407] Connection header received
0811 07:30:40.344339 (+ 1069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.344343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.344413 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.344544 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:40.346080 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.346723 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.348075 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.348339 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.348473 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.352017 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:40.352021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:40.352023 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:40.352049 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:40.353967 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.354577 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.354582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.354584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.354686 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.355116 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.355119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.355120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.355301 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:40.355406 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.356416 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.356635 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:30:40.357942 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.342125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:53839)
0811 07:30:40.343037 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.343096 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:40.344086 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:40.344758 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:40.344765 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:40.345274 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:30:40.345908 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.345924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.346875 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.346886 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.347904 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.347914 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.348525 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.348529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.348747 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.349571 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:30:40.349589 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:30:40.351817 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:30:40.354108 (+ 2291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:40.354115 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:40.354135 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:40.354458 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:40.354799 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:30:40.354804 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:30:40.354807 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:30:40.355006 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:30:40.355425 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:30:40.355436 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:30:40.355873 (+ 437us) client_negotiation.cc:769] Sending connection context
0811 07:30:40.356169 (+ 296us) client_negotiation.cc:240] Negotiation successful
0811 07:30:40.356621 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":128,"threads_started":1}
I20260811 07:30:40.358611 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.349779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.11.248.62:35837)
0811 07:30:40.350105 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.350110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.350127 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:30:40.350270 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.350273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.350341 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.350452 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:40.351448 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.352016 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.352968 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.353224 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.353341 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.354721 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:40.354724 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:40.354727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:40.354761 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:40.356791 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.357327 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.357332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.357334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.357450 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.357742 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.357746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.357748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.357927 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:40.358166 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.358304 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.358427 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":131,"threads_started":1}
I20260811 07:30:40.359434 30765 heartbeater.cc:347] Connected to a master server at 127.11.248.62:35837
I20260811 07:30:40.359704 30765 heartbeater.cc:464] Registering TS with master...
I20260811 07:30:40.360329 30765 heartbeater.cc:511] Master 127.11.248.62:35837 requested a full tablet report, sending...
I20260811 07:30:40.361517 30228 ts_manager.cc:194] Registered new tserver with Master: a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295)
I20260811 07:30:40.362141 30228 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:53839
I20260811 07:30:40.373016 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:30:40.377895 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.373754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60086 (local address 127.11.248.62:35837)
0811 07:30:40.373957 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.373963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.374231 (+ 268us) server_negotiation.cc:407] Connection header received
0811 07:30:40.374398 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.374401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.374521 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.374621 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:30:40.374898 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.375482 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.376518 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.376790 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.376967 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.377309 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:30:40.377467 (+ 158us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 07:30:40.377719 (+ 252us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60086: token expired
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 07:30:40.378008 30769 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60086: token expired
W20260811 07:30:40.378461 30139 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.248.62:35837)
I20260811 07:30:40.386622 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.378966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60098 (local address 127.11.248.62:35837)
0811 07:30:40.379111 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.379115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.379131 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:30:40.379172 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.379174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.379211 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.379303 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:30:40.379963 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.380490 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.381397 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.381632 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.381753 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.383228 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:30:40.383232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:30:40.383235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:30:40.383269 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:30:40.384772 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.385289 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.385292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.385294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.385384 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:30:40.385693 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:30:40.385697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:30:40.385699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:30:40.385910 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:30:40.386056 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.386294 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.386427 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:30:40.389781 30228 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:30:40.393628 30228 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:30:40.402447 30364 tablet_service.cc:1467] Processing CreateTablet for tablet 75bdb7fa5d554511bb245ba9d269a6ca (DEFAULT_TABLE table=test-table [id=312cbbb799724138996e38b5d719d704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:40.403234 30364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75bdb7fa5d554511bb245ba9d269a6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:40.406641 30315 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Bootstrap starting.
I20260811 07:30:40.407384 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.400977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:38295 (local address 127.0.0.1:33882)
0811 07:30:40.401157 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.401173 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:40.401260 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:40.402438 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:40.402441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:40.402463 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:40.402588 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.402595 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.404231 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.404234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.405612 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.405624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.406890 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.406896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.407010 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.407077 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 07:30:40.407134 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 07:30:40.407234 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":41}
I20260811 07:30:40.407684 30315 tablet_bootstrap.cc:654] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:40.408213 30774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.401148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33882 (local address 127.11.248.3:38295)
0811 07:30:40.401880 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.401895 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.401925 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:30:40.402011 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.402017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.402256 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.402434 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:40.402761 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.403923 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.405758 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.406724 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.407683 (+ 959us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.407879 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.407938 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.408042 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":198,"threads_started":1}
I20260811 07:30:40.408572 30775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.401245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40161 (local address 127.0.0.1:54230)
0811 07:30:40.401633 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.401650 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:40.401743 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:40.402652 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:40.402659 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:40.402682 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:40.402785 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.402790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.404739 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.404745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.405823 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.405831 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.407927 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.407930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.408078 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.408115 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:30:40.408214 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 07:30:40.408287 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":43,"thread_start_us":131,"threads_started":1}
I20260811 07:30:40.408610 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.401464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54230 (local address 127.11.248.2:40161)
0811 07:30:40.401890 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.401902 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.401925 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:30:40.402011 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.402017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.402256 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.402434 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:40.402992 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.404609 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.405949 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.407793 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.407915 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.408034 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.408367 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.408475 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":132,"threads_started":1}
I20260811 07:30:40.409802 30315 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: No bootstrap required, opened a new log
I20260811 07:30:40.409933 30315 ts_tablet_manager.cc:1397] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:30:40.410403 30315 raft_consensus.cc:348] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.410534 30315 raft_consensus.cc:374] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:40.410633 30315 raft_consensus.cc:729] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db21062ca104f8cbafd7208694b7833, State: Initialized, Role: FOLLOWER
I20260811 07:30:40.410777 30315 consensus_queue.cc:260] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.411064 30315 ts_tablet_manager.cc:1428] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:30:40.411641 30688 tablet_service.cc:1467] Processing CreateTablet for tablet 75bdb7fa5d554511bb245ba9d269a6ca (DEFAULT_TABLE table=test-table [id=312cbbb799724138996e38b5d719d704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:40.411641 30523 tablet_service.cc:1467] Processing CreateTablet for tablet 75bdb7fa5d554511bb245ba9d269a6ca (DEFAULT_TABLE table=test-table [id=312cbbb799724138996e38b5d719d704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:30:40.412876 30523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75bdb7fa5d554511bb245ba9d269a6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:40.412885 30688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75bdb7fa5d554511bb245ba9d269a6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:30:40.422147 30779 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Bootstrap starting.
I20260811 07:30:40.422937 30778 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Bootstrap starting.
I20260811 07:30:40.425006 30779 tablet_bootstrap.cc:654] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:40.425894 30778 tablet_bootstrap.cc:654] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Neither blocks nor log segments found. Creating new log.
I20260811 07:30:40.426719 30779 log.cc:824] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:40.426745 30778 log.cc:824] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:30:40.429461 30778 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: No bootstrap required, opened a new log
I20260811 07:30:40.429469 30779 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: No bootstrap required, opened a new log
I20260811 07:30:40.429703 30778 ts_tablet_manager.cc:1397] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:30:40.429705 30779 ts_tablet_manager.cc:1397] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260811 07:30:40.432952 30778 raft_consensus.cc:348] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.433276 30778 raft_consensus.cc:374] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:40.433369 30778 raft_consensus.cc:729] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f2345d9f3b4443b68ac5e45ddcaba8, State: Initialized, Role: FOLLOWER
I20260811 07:30:40.433564 30779 raft_consensus.cc:348] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.433840 30779 raft_consensus.cc:374] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:30:40.433938 30779 raft_consensus.cc:729] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3437e8ac5f04ed39b0214020abebe07, State: Initialized, Role: FOLLOWER
I20260811 07:30:40.433862 30778 consensus_queue.cc:260] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.434376 30779 consensus_queue.cc:260] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.434718 30608 heartbeater.cc:503] Master 127.11.248.62:35837 was elected leader, sending a full tablet report...
I20260811 07:30:40.435065 30778 ts_tablet_manager.cc:1428] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 07:30:40.435125 30765 heartbeater.cc:503] Master 127.11.248.62:35837 was elected leader, sending a full tablet report...
I20260811 07:30:40.436604 30779 ts_tablet_manager.cc:1428] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260811 07:30:40.590612 30766 tablet.cc:2369] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:30:40.622061 30609 tablet.cc:2369] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:30:40.654352 30441 tablet.cc:2369] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:30:40.677156 30782 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:30:40.677392 30782 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.678614 30782 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879)
I20260811 07:30:40.684275 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.679506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:41197 (local address 127.11.248.1:36879)
0811 07:30:40.679959 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.679963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.679981 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:30:40.680042 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.680044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.680135 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.680253 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:40.680559 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.681280 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.682884 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.683599 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.683714 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.683983 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.684031 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.684123 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":87,"threads_started":1}
I20260811 07:30:40.684274 30774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.679172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:59731 (local address 127.11.248.3:38295)
0811 07:30:40.679348 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.679353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.679500 (+ 147us) server_negotiation.cc:407] Connection header received
0811 07:30:40.679590 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.679596 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.679662 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.679776 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:30:40.680164 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.680991 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.682884 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.683498 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.683667 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.683730 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.684031 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.684119 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:30:40.684299 30788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.679430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36879 (local address 127.11.248.2:41197)
0811 07:30:40.679843 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.679858 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:40.679959 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:40.680293 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:40.680296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:40.680314 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:40.680423 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.680428 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.681424 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.681428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.682715 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.682723 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.683713 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.683716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.683850 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.683878 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:30:40.683957 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 07:30:40.684074 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":93,"thread_start_us":106,"threads_started":1}
I20260811 07:30:40.684304 30787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.678901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:38295 (local address 127.11.248.2:59731)
0811 07:30:40.679247 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.679295 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:30:40.679463 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:30:40.679804 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:30:40.679814 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:30:40.679840 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:30:40.680024 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.680033 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.681145 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.681148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.682709 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:30:40.682723 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.683668 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.683675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:30:40.683813 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.683907 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 07:30:40.683976 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 07:30:40.684074 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":124,"thread_start_us":110,"threads_started":1}
I20260811 07:30:40.685083 30388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bdb7fa5d554511bb245ba9d269a6ca" candidate_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8db21062ca104f8cbafd7208694b7833" is_pre_election: true
I20260811 07:30:40.685505 30388 raft_consensus.cc:2454] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f2345d9f3b4443b68ac5e45ddcaba8 in term 0.
I20260811 07:30:40.685469 30712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bdb7fa5d554511bb245ba9d269a6ca" candidate_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3437e8ac5f04ed39b0214020abebe07" is_pre_election: true
I20260811 07:30:40.685755 30712 raft_consensus.cc:2454] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f2345d9f3b4443b68ac5e45ddcaba8 in term 0.
I20260811 07:30:40.686175 30471 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f2345d9f3b4443b68ac5e45ddcaba8, 8db21062ca104f8cbafd7208694b7833; no voters:
I20260811 07:30:40.686527 30782 raft_consensus.cc:2781] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:30:40.686626 30782 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:30:40.686673 30782 raft_consensus.cc:3037] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:40.687830 30782 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.688477 30782 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [CANDIDATE]: Term 1 election: Requested vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879)
I20260811 07:30:40.688715 30712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bdb7fa5d554511bb245ba9d269a6ca" candidate_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3437e8ac5f04ed39b0214020abebe07"
I20260811 07:30:40.688892 30388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bdb7fa5d554511bb245ba9d269a6ca" candidate_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8db21062ca104f8cbafd7208694b7833"
I20260811 07:30:40.688938 30712 raft_consensus.cc:3037] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:40.689044 30388 raft_consensus.cc:3037] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:30:40.690490 30388 raft_consensus.cc:2454] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f2345d9f3b4443b68ac5e45ddcaba8 in term 1.
I20260811 07:30:40.690490 30712 raft_consensus.cc:2454] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f2345d9f3b4443b68ac5e45ddcaba8 in term 1.
I20260811 07:30:40.690968 30471 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f2345d9f3b4443b68ac5e45ddcaba8, 8db21062ca104f8cbafd7208694b7833; no voters:
I20260811 07:30:40.691238 30782 raft_consensus.cc:2781] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:30:40.691567 30782 raft_consensus.cc:686] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 LEADER]: Becoming Leader. State: Replica: 51f2345d9f3b4443b68ac5e45ddcaba8, State: Running, Role: LEADER
I20260811 07:30:40.691938 30782 consensus_queue.cc:237] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:30:40.696045 30226 catalog_manager.cc:5495] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } health_report { overall_health: UNKNOWN } } }
I20260811 07:30:40.710984 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:30:40.706959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54240 (local address 127.11.248.2:40161)
0811 07:30:40.707134 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:30:40.707139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:30:40.707160 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:30:40.707239 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:30:40.707241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:30:40.707302 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:30:40.707443 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:30:40.707701 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.708244 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.709262 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:30:40.709516 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:30:40.709644 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:30:40.709999 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:30:40.710571 (+ 572us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:30:40.710708 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 07:30:40.710749 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 07:30:40.710815 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:30:40.718406 30712 raft_consensus.cc:1261] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Refusing update from remote peer 51f2345d9f3b4443b68ac5e45ddcaba8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:30:40.718405 30388 raft_consensus.cc:1261] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Refusing update from remote peer 51f2345d9f3b4443b68ac5e45ddcaba8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:30:40.719415 30782 consensus_queue.cc:1035] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:30:40.719666 30790 consensus_queue.cc:1035] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:30:40.727638 30795 mvcc.cc:205] Tried to move back new op lower bound from 7317231373173129216 to 7317231373076979712. Current Snapshot: MvccSnapshot[applied={T|T < 7317231373173129216}]
I20260811 07:30:40.730640 30796 mvcc.cc:205] Tried to move back new op lower bound from 7317231373173129216 to 7317231373076979712. Current Snapshot: MvccSnapshot[applied={T|T < 7317231373173129216}]
I20260811 07:30:40.738317 30226 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:30:40.738569 30226 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:30:40.741685 30226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Sending DeleteTablet for 3 replicas of tablet 75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:30:40.742651 30523 tablet_service.cc:1514] Processing DeleteTablet for tablet 75bdb7fa5d554511bb245ba9d269a6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:40 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:54230
I20260811 07:30:40.742825 30364 tablet_service.cc:1514] Processing DeleteTablet for tablet 75bdb7fa5d554511bb245ba9d269a6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:40 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:35136
I20260811 07:30:40.742955 30688 tablet_service.cc:1514] Processing DeleteTablet for tablet 75bdb7fa5d554511bb245ba9d269a6ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:30:40 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:33882
I20260811 07:30:40.743402 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 30271
I20260811 07:30:40.743465 30805 tablet_replica.cc:330] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: stopping tablet replica
I20260811 07:30:40.746537 30805 raft_consensus.cc:2229] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:30:40.743465 30807 tablet_replica.cc:330] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: stopping tablet replica
I20260811 07:30:40.747252 30805 raft_consensus.cc:2258] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:40.747572 30807 raft_consensus.cc:2229] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:30:40.747941 30807 raft_consensus.cc:2258] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:30:40.750214 30805 ts_tablet_manager.cc:1905] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:40.752266 30807 ts_tablet_manager.cc:1905] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:30:40.754370 30805 ts_tablet_manager.cc:1918] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:40.754558 30805 log.cc:1196] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:30:40.754982 30805 ts_tablet_manager.cc:1939] T 75bdb7fa5d554511bb245ba9d269a6ca P 51f2345d9f3b4443b68ac5e45ddcaba8: Deleting consensus metadata
I20260811 07:30:40.755954 30807 ts_tablet_manager.cc:1918] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:30:40.756170 30807 log.cc:1196] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:30:40.756772 30807 ts_tablet_manager.cc:1939] T 75bdb7fa5d554511bb245ba9d269a6ca P a3437e8ac5f04ed39b0214020abebe07: Deleting consensus metadata
I20260811 07:30:40.756721 30207 catalog_manager.cc:4841] TS 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): tablet 75bdb7fa5d554511bb245ba9d269a6ca (table test-table [id=312cbbb799724138996e38b5d719d704]) successfully deleted
W20260811 07:30:40.757419 30211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:36879 (error 108)
I20260811 07:30:40.758530 30211 catalog_manager.cc:4841] TS a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): tablet 75bdb7fa5d554511bb245ba9d269a6ca (table test-table [id=312cbbb799724138996e38b5d719d704]) successfully deleted
W20260811 07:30:40.758740 30775 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:30:40.758345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:36879 (local address 127.0.0.1:35140)
0811 07:30:40.758530 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:30:40.758631 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:36879: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 07:30:40.758910 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 30444
W20260811 07:30:40.758932 30211 catalog_manager.cc:4584] TS 8db21062ca104f8cbafd7208694b7833 (127.11.248.1:36879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 75bdb7fa5d554511bb245ba9d269a6ca: Network error: Client connection negotiation failed: client connection to 127.11.248.1:36879: connect: Connection reset by peer (error 104)
I20260811 07:30:40.768549 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 30611
I20260811 07:30:40.777413 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 30185
I20260811 07:31:00.788025 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35837
--webserver_interface=127.11.248.62
--webserver_port=46625
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:35837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:00.925860 30810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:00.926268 30810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:00.926354 30810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:00.930819 30810 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:31:00.930944 30810 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:31:00.930975 30810 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:31:00.931000 30810 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:00.931042 30810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:00.931092 30810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:00.931149 30810 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:00.931192 30810 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:00.937022 30810 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:35837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:35837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=46625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:00.938318 30810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:00.939534 30810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:00.950830 30821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:00.950991 30817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:00.951040 30818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:00.951131 30810 server_base.cc:1034] running on GCE node
I20260811 07:31:00.952049 30810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:00.953369 30810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:00.954588 30810 hybrid_clock.cc:648] HybridClock initialized: now 1786433460954555 us; error 52 us; skew 500 ppm
Aug 11 07:31:00 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:00.963340 30810 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:00.964797 30810 webserver.cc:460] Webserver started at http://127.11.248.62:46625/ using document root <none> and password file <none>
I20260811 07:31:00.965592 30810 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:00.965715 30810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:00.970743 30810 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 07:31:00.973694 30828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:00.975431 30810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:31:00.975648 30810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "92448a0625254fdbbb4f6374c4fd530c"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "9550a177851ec457d412cdd155d70740"
server_key_iv: "f2c143af163150071112024ce255ea5e"
server_key_version: "encryptionkey@0"
I20260811 07:31:00.976419 30810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:00.998917 30810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:01.003002 30810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:01.003286 30810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:01.012641 30810 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:35837
I20260811 07:31:01.013046 30887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:35837 every 8 connection(s)
I20260811 07:31:01.014107 30810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:01.019086 30889 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:31:01.020130 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 30810
I20260811 07:31:01.020706 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:36879
--local_ip_for_outbound_sockets=127.11.248.1
--tserver_master_addrs=127.11.248.62:35837
--webserver_port=33523
--webserver_interface=127.11.248.1
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:31:01.021387 30889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap starting.
I20260811 07:31:01.042471 30889 log.cc:824] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:01.056159 30889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:31:01.056711 30889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Bootstrap complete.
I20260811 07:31:01.061861 30889 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:31:01.062424 30889 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92448a0625254fdbbb4f6374c4fd530c, State: Initialized, Role: FOLLOWER
I20260811 07:31:01.063014 30889 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:31:01.063195 30889 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:01.063313 30889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:01.063470 30889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:31:01.066057 30889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:31:01.066579 30889 leader_election.cc:302] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92448a0625254fdbbb4f6374c4fd530c; no voters:
I20260811 07:31:01.066977 30889 leader_election.cc:288] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:31:01.067153 30893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:31:01.067435 30893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [term 3 LEADER]: Becoming Leader. State: Replica: 92448a0625254fdbbb4f6374c4fd530c, State: Running, Role: LEADER
I20260811 07:31:01.067896 30893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } }
I20260811 07:31:01.068436 30889 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:01.069582 30894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "92448a0625254fdbbb4f6374c4fd530c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } } }
I20260811 07:31:01.069731 30894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:01.070511 30895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92448a0625254fdbbb4f6374c4fd530c. Latest consensus state: current_term: 3 leader_uuid: "92448a0625254fdbbb4f6374c4fd530c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92448a0625254fdbbb4f6374c4fd530c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 35837 } } }
I20260811 07:31:01.070603 30895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:01.071136 30903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:01.077682 30903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:01.078490 30903 catalog_manager.cc:1259] Loaded cluster ID: 457982688f0a445496caba48ddd2f338
I20260811 07:31:01.078575 30903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:01.081374 30903 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:01.082333 30903 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Loaded TSK: 0
I20260811 07:31:01.082439 30903 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92448a0625254fdbbb4f6374c4fd530c: Loaded TSK: 1
F20260811 07:31:01.083204 30903 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f47dfb509ad google::LogMessage::Fail() at ??:0
@ 0x7f47dfb5388a google::LogMessage::SendToLog() at ??:0
@ 0x7f47dfb504de google::LogMessage::Flush() at ??:0
@ 0x7f47dfb51a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f47e281418d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f47e280cf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f47ea4b57bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f47ea48f99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f47ea490178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f47ea4d1df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f47ea4f082b std::function<>::operator()() at ??:0
@ 0x7f47ea48fb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f47ea490f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f47ea48d579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f47ea4d1640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f47e1da23d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f47e1da2c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f47e1da43f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f47e1d93512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f47e33d76db start_thread at ??:0
@ 0x7f47de64e61f clone at ??:0
W20260811 07:31:01.195734 30891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:01.196049 30891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:01.196098 30891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:01.200673 30891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:01.200767 30891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:01.200927 30891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:01.207149 30891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:36879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=33523
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:01.208529 30891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:01.209741 30891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:01.220523 30941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:01.220770 30944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:01.220481 30942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:01.221083 30891 server_base.cc:1034] running on GCE node
I20260811 07:31:01.221562 30891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:01.222361 30891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:01.223577 30891 hybrid_clock.cc:648] HybridClock initialized: now 1786433461223560 us; error 43 us; skew 500 ppm
Aug 11 07:31:01 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:01.227097 30891 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:31:01.228281 30891 webserver.cc:460] Webserver started at http://127.11.248.1:33523/ using document root <none> and password file <none>
I20260811 07:31:01.229095 30891 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:01.229226 30891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:01.234119 30891 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:01.237007 30953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.238745 30891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:31:01.238960 30891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "8db21062ca104f8cbafd7208694b7833"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "85facc67edaf299bc3e41a1270ad0221"
server_key_iv: "94bef1219ec7e4b0b3215adffbf71430"
server_key_version: "encryptionkey@0"
I20260811 07:31:01.239629 30891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:01.272712 30891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:01.276834 30891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:01.277112 30891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:01.277880 30891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:01.279171 30960 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:31:01.284055 30891 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:31:01.284160 30891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 07:31:01.284219 30891 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:31:01.286365 30891 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:31:01.286475 30891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260811 07:31:01.286823 30960 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Bootstrap starting.
I20260811 07:31:01.298491 30891 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:36879
I20260811 07:31:01.298789 31082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:36879 every 8 connection(s)
I20260811 07:31:01.299929 30891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:01.301110 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 30891
I20260811 07:31:01.301679 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:40161
--local_ip_for_outbound_sockets=127.11.248.2
--tserver_master_addrs=127.11.248.62:35837
--webserver_port=35303
--webserver_interface=127.11.248.2
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:31:01.312336 30960 log.cc:824] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:01.322880 30960 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:31:01.323496 30960 tablet_bootstrap.cc:492] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Bootstrap complete.
I20260811 07:31:01.325022 30960 ts_tablet_manager.cc:1397] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Time spent bootstrapping tablet: real 0.039s user 0.025s sys 0.011s
I20260811 07:31:01.328768 30960 raft_consensus.cc:348] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:01.329509 30960 raft_consensus.cc:729] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db21062ca104f8cbafd7208694b7833, State: Initialized, Role: FOLLOWER
I20260811 07:31:01.330075 30960 consensus_queue.cc:260] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:01.331297 30960 ts_tablet_manager.cc:1428] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
W20260811 07:31:01.349318 31085 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:01.303207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:53849)
0811 07:31:01.303755 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.303814 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:01.305207 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:01.348235 (+ 43028us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":176,"threads_started":1}
W20260811 07:31:01.350018 31083 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:35837 (0 consecutive failures): Network error: Failed to ping master at 127.11.248.62:35837: Client connection negotiation failed: client connection to 127.11.248.62:35837: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:31:01.350865 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.350547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:49991)
0811 07:31:01.350700 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.350790 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 07:31:01.351727 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.351480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:48559)
0811 07:31:01.351602 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.351656 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 07:31:01.352035 31083 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:31:01.436802 31086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:01.437235 31086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:01.437323 31086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:01.441891 31086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:01.442013 31086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:01.442123 31086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:01.448549 31086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:40161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=35303
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:01.449910 31086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:01.451110 31086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:01.463078 31094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:01.463136 31093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:01.463218 31086 server_base.cc:1034] running on GCE node
W20260811 07:31:01.463156 31097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:01.463999 31086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:01.464895 31086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:01.466106 31086 hybrid_clock.cc:648] HybridClock initialized: now 1786433461466088 us; error 36 us; skew 500 ppm
Aug 11 07:31:01 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:01.469508 31086 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:31:01.470546 31086 webserver.cc:460] Webserver started at http://127.11.248.2:35303/ using document root <none> and password file <none>
I20260811 07:31:01.471132 31086 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:01.471199 31086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:01.475639 31086 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:01.478200 31105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.479962 31086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:01.480185 31086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "51f2345d9f3b4443b68ac5e45ddcaba8"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "dac034029ea48f5229f925fa375ec307"
server_key_iv: "5ba41d0be2f04892b946efb3871c88c8"
server_key_version: "encryptionkey@0"
I20260811 07:31:01.480976 31086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:01.505776 31086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:01.509819 31086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:01.510025 31086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:01.510787 31086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:01.511756 31086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:01.511838 31086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.511927 31086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:01.511971 31086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.523911 31242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:40161 every 8 connection(s)
I20260811 07:31:01.523870 31086 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:40161
I20260811 07:31:01.525242 31086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:01.531385 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.529099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:46141)
0811 07:31:01.530195 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.530338 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":831,"thread_start_us":217,"threads_started":1}
I20260811 07:31:01.532421 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 31086
W20260811 07:31:01.532648 31243 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:35837 (0 consecutive failures): Network error: Failed to ping master at 127.11.248.62:35837: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
I20260811 07:31:01.533070 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:38295
--local_ip_for_outbound_sockets=127.11.248.3
--tserver_master_addrs=127.11.248.62:35837
--webserver_port=39051
--webserver_interface=127.11.248.3
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:31:01.533644 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.533259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:40597)
0811 07:31:01.533454 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.533538 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 07:31:01.534549 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.534229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:44863)
0811 07:31:01.534381 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.534459 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 07:31:01.534812 31243 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:31:01.672572 31247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:01.672951 31247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:01.673007 31247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:01.677428 31247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:01.677520 31247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:01.677584 31247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:01.683286 31247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:38295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=39051
--tserver_master_addrs=127.11.248.62:35837
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:01.684510 31247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:01.685698 31247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:01.696575 31253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:01.696580 31255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:01.696557 31257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:01.697053 31247 server_base.cc:1034] running on GCE node
I20260811 07:31:01.697489 31247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:01.698196 31247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:01.699393 31247 hybrid_clock.cc:648] HybridClock initialized: now 1786433461699352 us; error 44 us; skew 500 ppm
Aug 11 07:31:01 dist-test-slave-77v9 krb5kdc[29538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:01.702723 31247 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:31:01.703837 31247 webserver.cc:460] Webserver started at http://127.11.248.3:39051/ using document root <none> and password file <none>
I20260811 07:31:01.704480 31247 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:01.704602 31247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:01.709355 31247 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:01.712142 31264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.714040 31247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:01.714247 31247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "a3437e8ac5f04ed39b0214020abebe07"
format_stamp: "Formatted at 2026-08-11 07:30:18 on dist-test-slave-77v9"
server_key: "eeefb9e1dd1d0f12eab0cff30ce0f570"
server_key_iv: "3f01b7d8ce9c7906eb68bf29c3512b37"
server_key_version: "encryptionkey@0"
I20260811 07:31:01.714998 31247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:01.745106 31247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:01.749678 31247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:01.749971 31247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:01.750701 31247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:01.751686 31247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:01.751775 31247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.751850 31247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:01.751891 31247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:01.762888 31247 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:38295
I20260811 07:31:01.762936 31398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:38295 every 8 connection(s)
I20260811 07:31:01.764039 31247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:01.769140 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.766860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:52017)
0811 07:31:01.767980 (+ 1120us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.768134 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":865,"thread_start_us":595,"threads_started":1}
W20260811 07:31:01.769815 31399 heartbeater.cc:644] Failed to heartbeat to 127.11.248.62:35837 (0 consecutive failures): Network error: Failed to ping master at 127.11.248.62:35837: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
I20260811 07:31:01.770613 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.770345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:42309)
0811 07:31:01.770487 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.770546 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:31:01.771454 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:01.771174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:47527)
0811 07:31:01.771337 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:01.771388 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:31:01.771720 31399 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:31:01.774385 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 31247
I20260811 07:31:02.353873 31403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:02.353303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:44135)
0811 07:31:02.353627 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:02.353708 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":134,"threads_started":1}
I20260811 07:31:02.536152 31405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:02.535585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:50377)
0811 07:31:02.535955 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:02.536020 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":86,"threads_started":1}
I20260811 07:31:02.773434 31406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:02.772680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:36269)
0811 07:31:02.773107 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:02.773196 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":147,"threads_started":1}
I20260811 07:31:03.052464 31407 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:03.052681 31407 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:03.053915 31407 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
Aug 11 07:31:03 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.2@KRBTEST.COM
Aug 11 07:31:03 dist-test-slave-77v9 krb5kdc[29538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.3@KRBTEST.COM
I20260811 07:31:03.073999 31410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.054442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:44233 (local address 127.11.248.2:40161)
0811 07:31:03.054934 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:03.054966 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:03.055020 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:31:03.055970 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:03.055976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:03.056463 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:03.056850 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:03.059058 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.060675 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.063066 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.063957 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.064138 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:03.068530 (+ 4392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:03.068537 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:03.068551 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:03.068590 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:03.070890 (+ 2300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:03.071621 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:03.071627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:03.071630 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:03.071768 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:03.072201 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:03.072204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:03.072205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:03.072690 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:03.072870 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:03.073463 (+ 593us) server_negotiation.cc:299] Negotiation successful
0811 07:31:03.073789 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":113,"threads_started":1}
I20260811 07:31:03.074054 31408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.054273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:40161 (local address 127.11.248.1:44233)
0811 07:31:03.054675 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:03.054695 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:03.054940 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:03.056991 (+ 2051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:03.056998 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:03.057830 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:03.058746 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:03.058766 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.061049 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.061053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:03.062854 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:03.062871 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.064117 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.064122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:03.064526 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:03.065513 (+ 987us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:03.065543 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:03.068200 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:03.071071 (+ 2871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:03.071079 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:03.071095 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:03.071464 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:03.071884 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:03.071887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:03.071889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:03.072075 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:03.072838 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:03.072846 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:03.073110 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 07:31:03.073314 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 07:31:03.073839 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":827,"spinlock_wait_cycles":21248,"thread_start_us":121,"threads_started":1}
I20260811 07:31:03.074065 31409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.054273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:38295 (local address 127.11.248.1:36105)
0811 07:31:03.054981 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:03.054998 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:03.055096 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:03.056991 (+ 1895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:03.056998 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:03.057830 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:03.058741 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:03.058767 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.061049 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.061053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:03.062854 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:03.062871 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.064117 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.064122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:03.064544 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:03.065513 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:03.065542 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:03.068378 (+ 2836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:03.071189 (+ 2811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:03.071193 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:03.071195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:03.071475 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:03.071893 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:03.071896 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:03.071898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:03.072129 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:03.072985 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:03.072988 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:03.073110 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 07:31:03.073336 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 07:31:03.073744 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"mutex_wait_us":361,"spinlock_wait_cycles":38016,"thread_start_us":111,"threads_started":1}
I20260811 07:31:03.074043 31412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.054660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:36105 (local address 127.11.248.3:38295)
0811 07:31:03.055058 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:03.055081 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:03.055113 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:31:03.055964 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:03.055974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:03.056463 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:03.056850 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:03.059015 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.060675 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.063066 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:03.063886 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:03.064117 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:03.068650 (+ 4533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:03.068662 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:03.068675 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:03.068713 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:03.071030 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:03.071629 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:03.071634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:03.071638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:03.071768 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:03.072298 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:03.072302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:03.072304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:03.072748 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:03.073020 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:03.073502 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 07:31:03.073806 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":125,"threads_started":1}
W20260811 07:31:03.077165 30954 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
W20260811 07:31:03.077390 30957 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:31:03.077482 30957 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8db21062ca104f8cbafd7208694b7833; no voters: 51f2345d9f3b4443b68ac5e45ddcaba8, a3437e8ac5f04ed39b0214020abebe07
I20260811 07:31:03.078016 31407 raft_consensus.cc:2726] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:31:03.355307 31408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.354902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:56241)
0811 07:31:03.355124 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:03.355205 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260811 07:31:03.538209 31413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.537486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:58975)
0811 07:31:03.537891 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:03.538000 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":110,"threads_started":1}
I20260811 07:31:03.775027 31414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:03.774520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:57797)
0811 07:31:03.774852 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:03.774922 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":90,"threads_started":1}
I20260811 07:31:04.356788 31415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:04.356312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:43801)
0811 07:31:04.356604 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:04.356680 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":91,"threads_started":1}
I20260811 07:31:04.539700 31416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:04.539144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:41223)
0811 07:31:04.539519 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:04.539588 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":116,"threads_started":1}
I20260811 07:31:04.776674 31417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:04.776103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:47923)
0811 07:31:04.776473 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:04.776542 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":126,"threads_started":1}
I20260811 07:31:05.066658 31418 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:05.066843 31418 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:05.067361 31418 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
W20260811 07:31:05.068222 30957 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
W20260811 07:31:05.068429 30954 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:31:05.068508 30954 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8db21062ca104f8cbafd7208694b7833; no voters: 51f2345d9f3b4443b68ac5e45ddcaba8, a3437e8ac5f04ed39b0214020abebe07
I20260811 07:31:05.068663 31418 raft_consensus.cc:2726] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:31:05.358610 31420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:05.358010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:45189)
0811 07:31:05.358411 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:05.358501 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":149,"threads_started":1}
I20260811 07:31:05.541438 31421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:05.540918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:51341)
0811 07:31:05.541249 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:05.541325 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":103,"threads_started":1}
I20260811 07:31:05.778260 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:05.777756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:34045)
0811 07:31:05.778074 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:05.778156 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":85,"threads_started":1}
I20260811 07:31:06.360512 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:06.359858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:60381)
0811 07:31:06.360307 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:06.360383 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":93,"threads_started":1}
I20260811 07:31:06.543087 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:06.542577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:43395)
0811 07:31:06.542911 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:06.542986 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":90,"threads_started":1}
I20260811 07:31:06.779876 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:06.779227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:36805)
0811 07:31:06.779576 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:06.779661 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":96,"threads_started":1}
I20260811 07:31:07.362205 31427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:07.361581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:41379)
0811 07:31:07.361943 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:07.362030 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":103,"threads_started":1}
I20260811 07:31:07.544781 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:07.544120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:58315)
0811 07:31:07.544483 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:07.544554 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":88,"threads_started":1}
I20260811 07:31:07.671614 31429 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:07.671864 31429 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:07.672463 31429 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
W20260811 07:31:07.673554 30954 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
W20260811 07:31:07.673902 30957 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:31:07.673985 30957 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8db21062ca104f8cbafd7208694b7833; no voters: 51f2345d9f3b4443b68ac5e45ddcaba8, a3437e8ac5f04ed39b0214020abebe07
I20260811 07:31:07.674165 31429 raft_consensus.cc:2726] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:31:07.781569 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:07.781073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:33597)
0811 07:31:07.781391 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:07.781467 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":89,"threads_started":1}
I20260811 07:31:08.363776 31431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:08.363311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:35781)
0811 07:31:08.363619 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:08.363675 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":130,"threads_started":1}
I20260811 07:31:08.546499 31433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:08.545946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:33511)
0811 07:31:08.546310 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:08.546375 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":127,"threads_started":1}
I20260811 07:31:08.783506 31434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:08.782777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:39929)
0811 07:31:08.783318 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:08.783404 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":94,"threads_started":1}
I20260811 07:31:09.365401 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:09.364840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:50065)
0811 07:31:09.365219 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:09.365293 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":174,"threads_started":1}
I20260811 07:31:09.547981 31436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:09.547527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:44697)
0811 07:31:09.547806 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:09.547867 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":101,"threads_started":1}
I20260811 07:31:09.785058 31437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:09.784433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:57775)
0811 07:31:09.784775 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:09.784940 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":88,"threads_started":1}
I20260811 07:31:10.367045 31438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:10.366502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:37567)
0811 07:31:10.366821 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:10.366894 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":90,"threads_started":1}
I20260811 07:31:10.549360 31439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:10.548872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:59817)
0811 07:31:10.549185 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:10.549249 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":108,"threads_started":1}
I20260811 07:31:10.786641 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:10.786015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:39985)
0811 07:31:10.786444 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:10.786534 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":104,"threads_started":1}
I20260811 07:31:11.368754 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:11.368223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:50633)
0811 07:31:11.368570 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:11.368640 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":97,"threads_started":1}
I20260811 07:31:11.550956 31444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:11.550422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:35505)
0811 07:31:11.550766 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:11.550838 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":109,"threads_started":1}
I20260811 07:31:11.788329 31445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:11.787709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:60645)
0811 07:31:11.788081 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:11.788197 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":142,"threads_started":1}
I20260811 07:31:12.137590 31446 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:12.137734 31446 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:12.138237 31446 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
W20260811 07:31:12.139132 30954 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
W20260811 07:31:12.139236 30957 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:31:12.139295 30957 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8db21062ca104f8cbafd7208694b7833; no voters: 51f2345d9f3b4443b68ac5e45ddcaba8, a3437e8ac5f04ed39b0214020abebe07
I20260811 07:31:12.139483 31446 raft_consensus.cc:2726] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:31:12.370239 31447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:12.369693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:58703)
0811 07:31:12.370057 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:12.370131 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":94,"threads_started":1}
I20260811 07:31:12.552601 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:12.552025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:51539)
0811 07:31:12.552412 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:12.552490 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":96,"threads_started":1}
I20260811 07:31:12.790171 31449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:12.789468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:37007)
0811 07:31:12.789925 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:12.790037 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":132,"threads_started":1}
I20260811 07:31:13.371856 31450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:13.371358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:48697)
0811 07:31:13.371685 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:13.371754 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":94,"threads_started":1}
I20260811 07:31:13.554265 31451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:13.553728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:52845)
0811 07:31:13.554078 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:13.554151 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":93,"threads_started":1}
I20260811 07:31:13.791664 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:13.791162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:34215)
0811 07:31:13.791507 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:13.791565 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":129,"threads_started":1}
I20260811 07:31:14.373497 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:14.373016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:57593)
0811 07:31:14.373309 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:14.373387 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":84,"threads_started":1}
I20260811 07:31:14.555676 31454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:14.555193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:36717)
0811 07:31:14.555527 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:14.555578 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":117,"threads_started":1}
I20260811 07:31:14.787617 31455 raft_consensus.cc:482] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:14.787768 31455 raft_consensus.cc:504] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3437e8ac5f04ed39b0214020abebe07" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 38295 } } peers { permanent_uuid: "51f2345d9f3b4443b68ac5e45ddcaba8" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 40161 } } peers { permanent_uuid: "8db21062ca104f8cbafd7208694b7833" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 36879 } }
I20260811 07:31:14.788293 31455 leader_election.cc:288] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295), 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161)
W20260811 07:31:14.789290 30954 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51f2345d9f3b4443b68ac5e45ddcaba8 (127.11.248.2:40161): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
W20260811 07:31:14.789398 30957 leader_election.cc:341] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3437e8ac5f04ed39b0214020abebe07 (127.11.248.3:38295): Not found: Tablet not found: 75bdb7fa5d554511bb245ba9d269a6ca
I20260811 07:31:14.789536 30957 leader_election.cc:302] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8db21062ca104f8cbafd7208694b7833; no voters: 51f2345d9f3b4443b68ac5e45ddcaba8, a3437e8ac5f04ed39b0214020abebe07
I20260811 07:31:14.789713 31455 raft_consensus.cc:2726] T 75bdb7fa5d554511bb245ba9d269a6ca P 8db21062ca104f8cbafd7208694b7833 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:31:14.793051 31457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:14.792457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:42187)
0811 07:31:14.792870 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:14.792946 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":137,"threads_started":1}
I20260811 07:31:15.375144 31459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:15.374645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:45745)
0811 07:31:15.374961 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:15.375030 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":92,"threads_started":1}
I20260811 07:31:15.557389 31460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:15.556752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:49643)
0811 07:31:15.557181 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:15.557269 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":202,"threads_started":1}
I20260811 07:31:15.794476 31461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:15.793990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:57167)
0811 07:31:15.794304 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:15.794370 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":111,"threads_started":1}
I20260811 07:31:16.377125 31462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:16.376485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.1:33711)
0811 07:31:16.376948 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:16.377018 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":104,"threads_started":1}
I20260811 07:31:16.559356 31464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:16.558690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.2:57413)
0811 07:31:16.559150 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:16.559222 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":87,"threads_started":1}
I20260811 07:31:16.781634 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 30891
I20260811 07:31:16.791626 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 31086
I20260811 07:31:16.796149 31465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:16.795562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:35837 (local address 127.11.248.3:58943)
0811 07:31:16.795952 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:16.796034 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.62:35837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":84,"threads_started":1}
I20260811 07:31:16.801502 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 31247
2026-08-11T07:31:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60082 ms)
[----------] 30 tests from SecurityITest (263543 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:16 dist-test-slave-77v9 krb5kdc[31470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:16 dist-test-slave-77v9 krb5kdc[31470](info): set up 2 sockets
Aug 11 07:31:16 dist-test-slave-77v9 krb5kdc[31470](info): commencing operation
krb5kdc: starting...
W20260811 07:31:17.962574 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.007s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:18.116969 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43867
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:43867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:18.242756 31483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:18.243124 31483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:18.243206 31483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:18.247428 31483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:18.247514 31483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:18.247534 31483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:18.247552 31483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:18.247568 31483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:18.253427 31483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:43867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:18.254729 31483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:18.255872 31483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:18.266002 31488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:18.266047 31483 server_base.cc:1034] running on GCE node
W20260811 07:31:18.266002 31491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:18.266004 31489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:18.267155 31483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:18.268424 31483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:18.269646 31483 hybrid_clock.cc:648] HybridClock initialized: now 1786433478269602 us; error 64 us; skew 500 ppm
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:18.273077 31483 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:18.274199 31483 webserver.cc:460] Webserver started at http://127.11.248.62:41371/ using document root <none> and password file <none>
I20260811 07:31:18.274857 31483 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:18.274991 31483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:18.275230 31483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:18.277534 31483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "8e3b0e1bbbc34e948176e1cb187927c1"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "4935a632deb55b649594aec277316e2f"
server_key_iv: "8a69777ff96b4613bbc9af5764a32c1a"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.278124 31483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "8e3b0e1bbbc34e948176e1cb187927c1"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "4935a632deb55b649594aec277316e2f"
server_key_iv: "8a69777ff96b4613bbc9af5764a32c1a"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.282464 31483 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:18.285544 31498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.287144 31483 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:18.287284 31483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "8e3b0e1bbbc34e948176e1cb187927c1"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "4935a632deb55b649594aec277316e2f"
server_key_iv: "8a69777ff96b4613bbc9af5764a32c1a"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.287493 31483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:18.306383 31483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:18.309998 31483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:18.310236 31483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:18.318358 31483 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:43867
I20260811 07:31:18.318346 31558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:43867 every 8 connection(s)
I20260811 07:31:18.319492 31483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:18.322718 31559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:18.326561 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 31483
I20260811 07:31:18.326772 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:18.327158 12256 external_mini_cluster.cc:1428] Setting key 631f8c18f49f714ebfbe84e85d1b4405
I20260811 07:31:18.329632 31559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1: Bootstrap starting.
I20260811 07:31:18.332496 31559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:18.333524 31559 log.cc:824] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:18.335808 31559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1: No bootstrap required, opened a new log
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:18.339243 31559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43867 } }
I20260811 07:31:18.339552 31559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:18.339617 31559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e3b0e1bbbc34e948176e1cb187927c1, State: Initialized, Role: FOLLOWER
I20260811 07:31:18.340111 31559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43867 } }
I20260811 07:31:18.340240 31559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:18.340329 31559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:18.340432 31559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:18.341531 31559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43867 } }
I20260811 07:31:18.341907 31559 leader_election.cc:302] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e3b0e1bbbc34e948176e1cb187927c1; no voters:
I20260811 07:31:18.342291 31559 leader_election.cc:288] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:18.342410 31566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:18.342676 31566 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8e3b0e1bbbc34e948176e1cb187927c1, State: Running, Role: LEADER
I20260811 07:31:18.343218 31566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43867 } }
I20260811 07:31:18.343840 31559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:18.344586 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:18.328798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34238 (local address 127.11.248.62:43867)
0811 07:31:18.329341 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:18.329358 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:18.329402 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:31:18.330176 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:18.330207 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:18.330578 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:18.330886 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:18.331899 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.333118 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.334353 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.334877 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.335078 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:18.337864 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:18.337870 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:18.337887 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:18.337925 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:18.340640 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:18.341176 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:18.341182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:18.341188 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:18.341316 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:18.341626 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:18.341630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:18.341632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:18.342185 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:18.342411 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:18.343139 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 07:31:18.343480 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":168,"threads_started":1}
I20260811 07:31:18.345080 31567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43867 } } }
I20260811 07:31:18.345264 31567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:18.345412 31568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e3b0e1bbbc34e948176e1cb187927c1. Latest consensus state: current_term: 1 leader_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e3b0e1bbbc34e948176e1cb187927c1" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43867 } } }
I20260811 07:31:18.345530 31568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:18.346112 31577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:18.349673 31577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:18.355836 31577 catalog_manager.cc:1347] Generated new cluster ID: 37292adbb2ca4b4294dec8ce39d8c4f2
I20260811 07:31:18.355932 31577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:18.377025 31577 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:18.378486 31577 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:18.412086 31577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1: Generated new TSK 0
I20260811 07:31:18.413182 31577 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:31:18.457173 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43867
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:18.586119 31591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:18.586434 31591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:18.586539 31591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:18.591187 31591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:18.591310 31591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:18.591387 31591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:18.597517 31591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:18.598784 31591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:18.599891 31591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:18.610327 31597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:18.610370 31596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:18.610479 31591 server_base.cc:1034] running on GCE node
W20260811 07:31:18.610342 31600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:18.611114 31591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:18.611835 31591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:18.612994 31591 hybrid_clock.cc:648] HybridClock initialized: now 1786433478612979 us; error 48 us; skew 500 ppm
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:18.616473 31591 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:31:18.617767 31591 webserver.cc:460] Webserver started at http://127.11.248.1:36387/ using document root <none> and password file <none>
I20260811 07:31:18.618459 31591 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:18.618543 31591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:18.618849 31591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:18.621452 31591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "90110c16fa914fbda23a909779275fde"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "1e79e3d1d693deb84a7ff6b535932625"
server_key_iv: "c372047edb23528e921e6cfb6a3797c2"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.622172 31591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "90110c16fa914fbda23a909779275fde"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "1e79e3d1d693deb84a7ff6b535932625"
server_key_iv: "c372047edb23528e921e6cfb6a3797c2"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.627043 31591 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 07:31:18.630113 31607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.631618 31591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:18.631871 31591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "90110c16fa914fbda23a909779275fde"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "1e79e3d1d693deb84a7ff6b535932625"
server_key_iv: "c372047edb23528e921e6cfb6a3797c2"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.632028 31591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:18.651032 31591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:18.654963 31591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:18.655239 31591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:18.656008 31591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:18.657070 31591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:18.657150 31591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.657220 31591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:18.657270 31591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.666966 31591 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:44705
I20260811 07:31:18.666994 31738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:44705 every 8 connection(s)
I20260811 07:31:18.668035 31591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:18.677122 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 31591
I20260811 07:31:18.677295 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:31:18.677685 12256 external_mini_cluster.cc:1428] Setting key 3453c9fbfcb9f4926055dc9f1fb90c0f
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:18.683830 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:18.670274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49287 (local address 127.11.248.62:43867)
0811 07:31:18.670461 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:18.670466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:18.671316 (+ 850us) server_negotiation.cc:407] Connection header received
0811 07:31:18.672734 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:18.672738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:18.672804 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:18.673026 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:18.674310 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.674936 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.676248 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.676508 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.676631 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:18.679727 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:18.679730 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:18.679733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:18.679759 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:18.681358 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:18.682089 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:18.682098 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:18.682100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:18.682187 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:18.682582 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:18.682586 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:18.682588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:18.682796 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:18.682915 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:18.683485 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 07:31:18.683635 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:31:18.684880 31741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:18.670601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43867 (local address 127.11.248.1:49287)
0811 07:31:18.671126 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:18.671175 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:18.672484 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:18.673216 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:18.673223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:18.673630 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:18.674142 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:18.674155 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.675072 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.675076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:18.676109 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:18.676120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.676683 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.676688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:18.676939 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:18.677639 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:18.677656 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:18.679522 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:18.681529 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:18.681539 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:18.681564 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:18.681953 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:18.682299 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:18.682302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:18.682304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:18.682471 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:18.682924 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:18.682935 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:18.683222 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 07:31:18.683431 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 07:31:18.683807 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":139,"threads_started":1}
I20260811 07:31:18.686476 31739 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43867
I20260811 07:31:18.686760 31739 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:18.687342 31739 heartbeater.cc:511] Master 127.11.248.62:43867 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:31:18.689188 31517 ts_manager.cc:194] Registered new tserver with Master: 90110c16fa914fbda23a909779275fde (127.11.248.1:44705)
I20260811 07:31:18.690389 31517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:49287
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:31:18.714509 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43867
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:18.843286 31745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:18.843585 31745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:18.843675 31745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:18.848340 31745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:18.848429 31745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:18.848493 31745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:18.854431 31745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:18.855664 31745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:18.856758 31745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:18.867573 31751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:18.867599 31753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:18.867709 31745 server_base.cc:1034] running on GCE node
W20260811 07:31:18.867573 31750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:18.868444 31745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:18.869256 31745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:18.870486 31745 hybrid_clock.cc:648] HybridClock initialized: now 1786433478870465 us; error 34 us; skew 500 ppm
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:18.873863 31745 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:31:18.874924 31745 webserver.cc:460] Webserver started at http://127.11.248.2:46365/ using document root <none> and password file <none>
I20260811 07:31:18.875573 31745 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:18.875643 31745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:18.875869 31745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:18.878312 31745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "d00823f2d6cb44eca49ef116e9fe9008"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "b87a545015897f65af06d23319843781"
server_key_iv: "5139dc2787554a51b072c0cc35583b0e"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.878942 31745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "d00823f2d6cb44eca49ef116e9fe9008"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "b87a545015897f65af06d23319843781"
server_key_iv: "5139dc2787554a51b072c0cc35583b0e"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.883077 31745 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:18.885977 31760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.887719 31745 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:18.887876 31745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "d00823f2d6cb44eca49ef116e9fe9008"
format_stamp: "Formatted at 2026-08-11 07:31:18 on dist-test-slave-77v9"
server_key: "b87a545015897f65af06d23319843781"
server_key_iv: "5139dc2787554a51b072c0cc35583b0e"
server_key_version: "encryptionkey@0"
I20260811 07:31:18.888067 31745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:18.905323 31745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:18.909405 31745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:18.909662 31745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:18.910391 31745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:18.911374 31745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:18.911430 31745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.911476 31745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:18.911538 31745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:18.922617 31745 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:36569
I20260811 07:31:18.922638 31887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:36569 every 8 connection(s)
I20260811 07:31:18.923748 31745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:18.924538 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 31745
I20260811 07:31:18.924702 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:31:18.925132 12256 external_mini_cluster.cc:1428] Setting key 92507e7a3fa3554f852cf81933ae1dab
Aug 11 07:31:18 dist-test-slave-77v9 krb5kdc[31470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433478, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:31:18.940531 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:18.925948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:52969 (local address 127.11.248.62:43867)
0811 07:31:18.926117 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:18.926122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:18.927211 (+ 1089us) server_negotiation.cc:407] Connection header received
0811 07:31:18.928616 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:18.928623 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:18.928704 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:18.928866 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:18.930217 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.930991 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.932356 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.932615 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.932741 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:18.935714 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:18.935717 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:18.935720 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:18.935750 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:18.937674 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:18.938473 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:18.938478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:18.938480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:18.938585 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:18.939059 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:18.939065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:18.939067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:18.939307 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:18.939447 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:18.940062 (+ 615us) server_negotiation.cc:299] Negotiation successful
0811 07:31:18.940226 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:31:18.941545 31891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:18.926399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43867 (local address 127.11.248.2:52969)
0811 07:31:18.927019 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:18.927081 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:18.928376 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:18.929070 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:18.929081 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:18.929539 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:18.930043 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:18.930057 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.931137 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.931140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:18.932070 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:18.932082 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:18.932842 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:18.932847 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:18.933040 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:18.933754 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:18.933771 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:18.935476 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:18.937943 (+ 2467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:18.937952 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:18.937974 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:18.938335 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:18.938711 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:18.938715 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:18.938718 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:18.938902 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:18.939456 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:18.939466 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:18.939771 (+ 305us) client_negotiation.cc:769] Sending connection context
0811 07:31:18.939996 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 07:31:18.940402 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":196,"threads_started":1}
I20260811 07:31:18.943225 31889 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43867
I20260811 07:31:18.943578 31889 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:18.944177 31889 heartbeater.cc:511] Master 127.11.248.62:43867 requested a full tablet report, sending...
I20260811 07:31:18.945689 31517 ts_manager.cc:194] Registered new tserver with Master: d00823f2d6cb44eca49ef116e9fe9008 (127.11.248.2:36569)
I20260811 07:31:18.946627 31517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:52969
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:31:18.965441 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43867
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:19.089300 31894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:19.089685 31894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:19.089772 31894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:19.094547 31894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:19.094669 31894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:19.094859 31894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:19.100692 31894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:19.102061 31894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:19.103224 31894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:19.114362 31901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:19.114413 31900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:19.114444 31894 server_base.cc:1034] running on GCE node
W20260811 07:31:19.114372 31903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:19.115139 31894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:19.115873 31894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:19.117043 31894 hybrid_clock.cc:648] HybridClock initialized: now 1786433479117025 us; error 38 us; skew 500 ppm
Aug 11 07:31:19 dist-test-slave-77v9 krb5kdc[31470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433479, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:19.120457 31894 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:31:19.121564 31894 webserver.cc:460] Webserver started at http://127.11.248.3:45931/ using document root <none> and password file <none>
I20260811 07:31:19.122135 31894 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:19.122201 31894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:19.122388 31894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:19.124574 31894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "20068dcb4f7f43d38cec36a4cc292762"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "efd819f07284c4e1b2919245191b4928"
server_key_iv: "b958e580ad82b43c6a5551cc2ac2d82c"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.125227 31894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "20068dcb4f7f43d38cec36a4cc292762"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "efd819f07284c4e1b2919245191b4928"
server_key_iv: "b958e580ad82b43c6a5551cc2ac2d82c"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.129503 31894 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:31:19.132687 31910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.134531 31894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:19.134713 31894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "20068dcb4f7f43d38cec36a4cc292762"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "efd819f07284c4e1b2919245191b4928"
server_key_iv: "b958e580ad82b43c6a5551cc2ac2d82c"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.134853 31894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:19.163457 31894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:19.167301 31894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:19.167569 31894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:19.168273 31894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:19.169292 31894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:19.169374 31894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.169445 31894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:19.169490 31894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.180109 31894 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:41935
I20260811 07:31:19.180128 32037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:41935 every 8 connection(s)
I20260811 07:31:19.181128 31894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:19.185168 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 31894
I20260811 07:31:19.185297 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:31:19.185657 12256 external_mini_cluster.cc:1428] Setting key c5f233da58aeeecb98bbb86f33316302
Aug 11 07:31:19 dist-test-slave-77v9 krb5kdc[31470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433479, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:19.197286 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.183136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:41409 (local address 127.11.248.62:43867)
0811 07:31:19.183317 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.183322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.184192 (+ 870us) server_negotiation.cc:407] Connection header received
0811 07:31:19.185775 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.185779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.185846 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.185972 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:19.187414 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.188053 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.189364 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.189588 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.189684 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.192666 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:19.192670 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:19.192672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:19.192705 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:19.194634 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:19.195345 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:19.195348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:19.195349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:19.195444 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:19.195994 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:19.195997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:19.195998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:19.196200 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:19.196279 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.197028 (+ 749us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.197156 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:31:19.198297 32042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.183538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43867 (local address 127.11.248.3:41409)
0811 07:31:19.184022 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.184068 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.185540 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.186156 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.186163 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.186705 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:19.187270 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.187289 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.188187 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.188189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.189243 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.189253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.189733 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.189736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.189885 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.190554 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:19.190572 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:19.192402 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:19.194842 (+ 2440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:19.194849 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:19.194866 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:19.195211 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:19.195566 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:19.195569 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:19.195570 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:19.195869 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:19.196331 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:19.196337 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:19.196645 (+ 308us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.196986 (+ 341us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.197304 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":142,"threads_started":1}
I20260811 07:31:19.199977 32038 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43867
I20260811 07:31:19.200316 32038 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:19.201038 32038 heartbeater.cc:511] Master 127.11.248.62:43867 requested a full tablet report, sending...
I20260811 07:31:19.202214 31517 ts_manager.cc:194] Registered new tserver with Master: 20068dcb4f7f43d38cec36a4cc292762 (127.11.248.3:41935)
I20260811 07:31:19.202864 31517 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:41409
I20260811 07:31:19.213056 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:31:19.224702 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.215350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56236 (local address 127.11.248.62:43867)
0811 07:31:19.215528 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.215536 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.215673 (+ 137us) server_negotiation.cc:407] Connection header received
0811 07:31:19.215783 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.215785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.215831 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.215911 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:19.216747 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.217390 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.218322 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.218554 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.218670 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.220439 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:19.220443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:19.220445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:19.220480 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:19.222258 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:19.222879 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:19.222883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:19.222885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:19.223035 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:19.223415 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:19.223422 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:19.223425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:19.223859 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:19.224109 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.224444 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.224571 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:31:19.228322 31517 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:31:19.232954 31517 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:31:19.250768 32054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.243325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36569 (local address 127.0.0.1:39180)
0811 07:31:19.244350 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.244367 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.244472 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.245647 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.245650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.245668 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:19.245767 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.245773 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.247222 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.247224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.248607 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.248617 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.249936 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.249940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.250147 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.250248 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.250380 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.250582 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"mutex_wait_us":367,"thread_start_us":129,"threads_started":1}
I20260811 07:31:19.250768 32052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.243266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44705 (local address 127.0.0.1:45156)
0811 07:31:19.243645 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.243695 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.243828 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.245407 (+ 1579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.245417 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.245445 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:19.245642 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.245649 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.246913 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.246919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.248872 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.248901 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.249942 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.249945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.250151 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.250249 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.250383 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.250582 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":516,"thread_start_us":115,"threads_started":1}
I20260811 07:31:19.250731 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.243378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45156 (local address 127.11.248.1:44705)
0811 07:31:19.244722 (+ 1344us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.244730 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.244758 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:31:19.244897 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.244903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.245147 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.245785 (+ 638us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:19.245934 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.246776 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.249012 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.249811 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.249927 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.250089 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.250439 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.250554 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1232,"thread_start_us":81,"threads_started":1}
I20260811 07:31:19.251744 32055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.244069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:41935 (local address 127.0.0.1:34080)
0811 07:31:19.244664 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.244677 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.244758 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.245444 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.245446 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.245466 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:19.245615 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.245623 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.247190 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.247193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.248909 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.248916 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.251305 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.251310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.251402 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.251423 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.251507 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.251587 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":202,"thread_start_us":105,"threads_started":1}
I20260811 07:31:19.251866 32057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.244270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.11.248.3:41935)
0811 07:31:19.244745 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.244760 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.244782 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:31:19.245087 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.245095 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.245284 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.245473 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:19.245745 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.247037 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.250168 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.250986 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.251104 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.251246 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.251569 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.251681 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":161,"threads_started":1}
I20260811 07:31:19.252658 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.244147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39180 (local address 127.11.248.2:36569)
0811 07:31:19.245067 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.245078 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.245100 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:31:19.245170 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.245175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.245342 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.245484 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:19.245888 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.247067 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.248746 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.249741 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.249881 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.250089 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.251531 (+ 1442us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.251635 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":225,"threads_started":1}
I20260811 07:31:19.254885 31966 tablet_service.cc:1467] Processing CreateTablet for tablet e8e65fa28d2c4feabb41b7a492d752af (DEFAULT_TABLE table=test-table [id=a463363a741f448a8671c06226a573c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:19.254882 31662 tablet_service.cc:1467] Processing CreateTablet for tablet e8e65fa28d2c4feabb41b7a492d752af (DEFAULT_TABLE table=test-table [id=a463363a741f448a8671c06226a573c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:19.254905 31814 tablet_service.cc:1467] Processing CreateTablet for tablet e8e65fa28d2c4feabb41b7a492d752af (DEFAULT_TABLE table=test-table [id=a463363a741f448a8671c06226a573c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:19.256036 31814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e65fa28d2c4feabb41b7a492d752af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:19.256053 31966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e65fa28d2c4feabb41b7a492d752af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:19.256043 31662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8e65fa28d2c4feabb41b7a492d752af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:19.262775 32058 tablet_bootstrap.cc:492] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Bootstrap starting.
I20260811 07:31:19.263983 32059 tablet_bootstrap.cc:492] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde: Bootstrap starting.
I20260811 07:31:19.265168 32060 tablet_bootstrap.cc:492] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Bootstrap starting.
I20260811 07:31:19.266155 32058 tablet_bootstrap.cc:654] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:19.266275 32059 tablet_bootstrap.cc:654] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:19.267222 32059 log.cc:824] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:19.267302 32060 tablet_bootstrap.cc:654] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:19.267326 32058 log.cc:824] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:19.268523 32060 log.cc:824] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:19.269603 32059 tablet_bootstrap.cc:492] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde: No bootstrap required, opened a new log
I20260811 07:31:19.269603 32058 tablet_bootstrap.cc:492] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: No bootstrap required, opened a new log
I20260811 07:31:19.269826 32058 ts_tablet_manager.cc:1397] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:31:19.269826 32059 ts_tablet_manager.cc:1397] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:31:19.270457 32060 tablet_bootstrap.cc:492] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: No bootstrap required, opened a new log
I20260811 07:31:19.270661 32060 ts_tablet_manager.cc:1397] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:31:19.274144 32060 raft_consensus.cc:348] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.274575 32060 raft_consensus.cc:374] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:19.274405 32058 raft_consensus.cc:348] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.274668 32060 raft_consensus.cc:729] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20068dcb4f7f43d38cec36a4cc292762, State: Initialized, Role: FOLLOWER
I20260811 07:31:19.274713 32058 raft_consensus.cc:374] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:19.274796 32058 raft_consensus.cc:729] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00823f2d6cb44eca49ef116e9fe9008, State: Initialized, Role: FOLLOWER
I20260811 07:31:19.275241 32060 consensus_queue.cc:260] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.275245 32058 consensus_queue.cc:260] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.275224 32059 raft_consensus.cc:348] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.275494 32059 raft_consensus.cc:374] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:19.275550 32059 raft_consensus.cc:729] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90110c16fa914fbda23a909779275fde, State: Initialized, Role: FOLLOWER
I20260811 07:31:19.275990 32059 consensus_queue.cc:260] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.276415 32058 ts_tablet_manager.cc:1428] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 07:31:19.276420 32060 ts_tablet_manager.cc:1428] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:31:19.276835 31889 heartbeater.cc:503] Master 127.11.248.62:43867 was elected leader, sending a full tablet report...
I20260811 07:31:19.276856 31739 heartbeater.cc:503] Master 127.11.248.62:43867 was elected leader, sending a full tablet report...
I20260811 07:31:19.277035 32059 ts_tablet_manager.cc:1428] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:31:19.277535 32038 heartbeater.cc:503] Master 127.11.248.62:43867 was elected leader, sending a full tablet report...
I20260811 07:31:19.335436 32067 raft_consensus.cc:482] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:19.335668 32067 raft_consensus.cc:504] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.336979 32067 leader_election.cc:288] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00823f2d6cb44eca49ef116e9fe9008 (127.11.248.2:36569), 20068dcb4f7f43d38cec36a4cc292762 (127.11.248.3:41935)
I20260811 07:31:19.341941 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.337336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:41935 (local address 127.11.248.1:41749)
0811 07:31:19.337805 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.337818 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.337951 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.338266 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.338269 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.338286 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:19.338461 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.338471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.339500 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.339507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.340662 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.340672 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.341422 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.341426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.341548 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.341586 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.341682 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.341759 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":248,"thread_start_us":167,"threads_started":1}
I20260811 07:31:19.341924 32056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.337499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:47543 (local address 127.11.248.2:36569)
0811 07:31:19.337650 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.337655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.338100 (+ 445us) server_negotiation.cc:407] Connection header received
0811 07:31:19.338253 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.338256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.338314 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.338406 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:19.338835 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.339376 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.340834 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.341247 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.341390 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.341445 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.341694 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.341765 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:31:19.341958 32068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.337336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36569 (local address 127.11.248.1:47543)
0811 07:31:19.337951 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.337965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.338102 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.338451 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.338454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.338471 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:19.338628 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.338642 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.339544 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.339546 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.340660 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.340671 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.341397 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.341400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.341500 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.341580 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.341660 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.341742 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":103,"thread_start_us":135,"threads_started":1}
I20260811 07:31:19.342622 32057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.337521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:41749 (local address 127.11.248.3:41935)
0811 07:31:19.337669 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.337675 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.337919 (+ 244us) server_negotiation.cc:407] Connection header received
0811 07:31:19.338083 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.338086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.338144 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.338233 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:19.338618 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.339346 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.340828 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.341259 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.341404 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.341455 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.342412 (+ 957us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.342494 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:31:19.343262 31839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e65fa28d2c4feabb41b7a492d752af" candidate_uuid: "90110c16fa914fbda23a909779275fde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00823f2d6cb44eca49ef116e9fe9008" is_pre_election: true
I20260811 07:31:19.343271 31988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e65fa28d2c4feabb41b7a492d752af" candidate_uuid: "90110c16fa914fbda23a909779275fde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20068dcb4f7f43d38cec36a4cc292762" is_pre_election: true
I20260811 07:31:19.343621 31988 raft_consensus.cc:2454] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90110c16fa914fbda23a909779275fde in term 0.
I20260811 07:31:19.343623 31839 raft_consensus.cc:2454] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90110c16fa914fbda23a909779275fde in term 0.
I20260811 07:31:19.344233 31609 leader_election.cc:302] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 20068dcb4f7f43d38cec36a4cc292762, 90110c16fa914fbda23a909779275fde, d00823f2d6cb44eca49ef116e9fe9008; no voters:
I20260811 07:31:19.344612 32067 raft_consensus.cc:2781] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:31:19.344718 32067 raft_consensus.cc:482] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:31:19.344897 32067 raft_consensus.cc:3037] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:19.346268 32067 raft_consensus.cc:504] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.346680 32067 leader_election.cc:288] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [CANDIDATE]: Term 1 election: Requested vote from peers d00823f2d6cb44eca49ef116e9fe9008 (127.11.248.2:36569), 20068dcb4f7f43d38cec36a4cc292762 (127.11.248.3:41935)
I20260811 07:31:19.347170 31839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e65fa28d2c4feabb41b7a492d752af" candidate_uuid: "90110c16fa914fbda23a909779275fde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00823f2d6cb44eca49ef116e9fe9008"
I20260811 07:31:19.347342 31988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8e65fa28d2c4feabb41b7a492d752af" candidate_uuid: "90110c16fa914fbda23a909779275fde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20068dcb4f7f43d38cec36a4cc292762"
I20260811 07:31:19.347330 31839 raft_consensus.cc:3037] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:19.347529 31988 raft_consensus.cc:3037] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:19.348670 31839 raft_consensus.cc:2454] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90110c16fa914fbda23a909779275fde in term 1.
I20260811 07:31:19.348675 31988 raft_consensus.cc:2454] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90110c16fa914fbda23a909779275fde in term 1.
I20260811 07:31:19.349193 31611 leader_election.cc:302] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 20068dcb4f7f43d38cec36a4cc292762, 90110c16fa914fbda23a909779275fde, d00823f2d6cb44eca49ef116e9fe9008; no voters:
I20260811 07:31:19.349422 32067 raft_consensus.cc:2781] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:19.349745 32067 raft_consensus.cc:686] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [term 1 LEADER]: Becoming Leader. State: Replica: 90110c16fa914fbda23a909779275fde, State: Running, Role: LEADER
I20260811 07:31:19.350183 32067 consensus_queue.cc:237] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } }
I20260811 07:31:19.353796 31512 catalog_manager.cc:5495] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde reported cstate change: term changed from 0 to 1, leader changed from <none> to 90110c16fa914fbda23a909779275fde (127.11.248.1). New cstate: current_term: 1 leader_uuid: "90110c16fa914fbda23a909779275fde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90110c16fa914fbda23a909779275fde" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 } health_report { overall_health: UNKNOWN } } }
I20260811 07:31:19.377130 32053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.373255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45170 (local address 127.11.248.1:44705)
0811 07:31:19.373402 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.373408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.373425 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:31:19.373591 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.373594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.373654 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.373783 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:31:19.374053 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.374571 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.375480 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.375705 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.375824 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.376167 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:31:19.376625 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:31:19.376775 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.376891 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.376970 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:31:19.384295 31988 raft_consensus.cc:1261] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 1 FOLLOWER]: Refusing update from remote peer 90110c16fa914fbda23a909779275fde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:19.384296 31839 raft_consensus.cc:1261] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 1 FOLLOWER]: Refusing update from remote peer 90110c16fa914fbda23a909779275fde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:19.385154 32071 consensus_queue.cc:1035] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00823f2d6cb44eca49ef116e9fe9008" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:19.385424 32067 consensus_queue.cc:1035] T e8e65fa28d2c4feabb41b7a492d752af P 90110c16fa914fbda23a909779275fde [LEADER]: Connected to new peer: Peer: permanent_uuid: "20068dcb4f7f43d38cec36a4cc292762" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:19.396389 32075 mvcc.cc:205] Tried to move back new op lower bound from 7317231531548823552 to 7317231531421491200. Current Snapshot: MvccSnapshot[applied={T|T < 7317231531548823552}]
I20260811 07:31:19.405220 31512 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:19.405418 31512 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:19.408316 31512 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8e3b0e1bbbc34e948176e1cb187927c1: Sending DeleteTablet for 3 replicas of tablet e8e65fa28d2c4feabb41b7a492d752af
I20260811 07:31:19.409408 31814 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e65fa28d2c4feabb41b7a492d752af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:39180
I20260811 07:31:19.409452 31966 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e65fa28d2c4feabb41b7a492d752af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:34080
I20260811 07:31:19.410071 32085 tablet_replica.cc:330] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: stopping tablet replica
I20260811 07:31:19.410234 31662 tablet_service.cc:1514] Processing DeleteTablet for tablet e8e65fa28d2c4feabb41b7a492d752af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:19 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:45156
I20260811 07:31:19.410463 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 31591
I20260811 07:31:19.410470 32085 raft_consensus.cc:2229] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:19.410820 32085 raft_consensus.cc:2258] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:19.413254 32085 ts_tablet_manager.cc:1905] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:19.414299 32086 tablet_replica.cc:330] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: stopping tablet replica
I20260811 07:31:19.414709 32086 raft_consensus.cc:2229] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:19.415110 32086 raft_consensus.cc:2258] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:19.416131 32085 ts_tablet_manager.cc:1918] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:19.416256 32085 log.cc:1196] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/e8e65fa28d2c4feabb41b7a492d752af
I20260811 07:31:19.416610 32085 ts_tablet_manager.cc:1939] T e8e65fa28d2c4feabb41b7a492d752af P d00823f2d6cb44eca49ef116e9fe9008: Deleting consensus metadata
I20260811 07:31:19.417112 32086 ts_tablet_manager.cc:1905] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:19.418376 31502 catalog_manager.cc:4841] TS d00823f2d6cb44eca49ef116e9fe9008 (127.11.248.2:36569): tablet e8e65fa28d2c4feabb41b7a492d752af (table test-table [id=a463363a741f448a8671c06226a573c5]) successfully deleted
I20260811 07:31:19.419832 32086 ts_tablet_manager.cc:1918] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:19.419936 32086 log.cc:1196] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/e8e65fa28d2c4feabb41b7a492d752af
I20260811 07:31:19.420315 32086 ts_tablet_manager.cc:1939] T e8e65fa28d2c4feabb41b7a492d752af P 20068dcb4f7f43d38cec36a4cc292762: Deleting consensus metadata
W20260811 07:31:19.421228 31500 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:44705 (error 108)
I20260811 07:31:19.421528 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 31745
I20260811 07:31:19.422703 31500 catalog_manager.cc:4841] TS 20068dcb4f7f43d38cec36a4cc292762 (127.11.248.3:41935): tablet e8e65fa28d2c4feabb41b7a492d752af (table test-table [id=a463363a741f448a8671c06226a573c5]) successfully deleted
I20260811 07:31:19.423923 32055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.423617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44705 (local address 127.0.0.1:45176)
0811 07:31:19.423752 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.423833 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:44705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:31:19.424103 31500 catalog_manager.cc:4584] TS 90110c16fa914fbda23a909779275fde (127.11.248.1:44705): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8e65fa28d2c4feabb41b7a492d752af: Network error: Client connection negotiation failed: client connection to 127.11.248.1:44705: connect: Connection refused (error 111)
I20260811 07:31:19.432329 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 31894
I20260811 07:31:19.441356 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 31483
2026-08-11T07:31:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2639 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T07:31:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:19Z Disabled control of system clock
I20260811 07:31:19.481612 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44383
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:44383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:31:19.603150 32092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:19.603480 32092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:19.603521 32092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:19.607867 32092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:19.607963 32092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:19.607980 32092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:19.607997 32092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:19.608013 32092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:19.613343 32092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:44383
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:19.614656 32092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:19.616182 32092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:19.625880 32100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:19.625953 32092 server_base.cc:1034] running on GCE node
W20260811 07:31:19.625859 32099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:19.625990 32102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:19.626916 32092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:19.628258 32092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:19.629545 32092 hybrid_clock.cc:648] HybridClock initialized: now 1786433479629493 us; error 82 us; skew 500 ppm
I20260811 07:31:19.631944 32092 webserver.cc:460] Webserver started at http://127.11.248.62:46445/ using document root <none> and password file <none>
I20260811 07:31:19.632643 32092 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:19.632763 32092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:19.633057 32092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:19.635445 32092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "66e036801e6440d9b51eda65dc7503a9"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "452a22fabbcfde0c966fc4f0aa34ff9c"
server_key_iv: "7f405ce5e105f996e416ab0d27acc0cf"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.636124 32092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "66e036801e6440d9b51eda65dc7503a9"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "452a22fabbcfde0c966fc4f0aa34ff9c"
server_key_iv: "7f405ce5e105f996e416ab0d27acc0cf"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.640385 32092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:31:19.643280 32109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.644788 32092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:31:19.645056 32092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "66e036801e6440d9b51eda65dc7503a9"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "452a22fabbcfde0c966fc4f0aa34ff9c"
server_key_iv: "7f405ce5e105f996e416ab0d27acc0cf"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.645234 32092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:19.662987 32092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:19.663830 32092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:19.664012 32092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:19.673059 32092 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:44383
I20260811 07:31:19.673067 32166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:44383 every 8 connection(s)
I20260811 07:31:19.674237 32092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:19.677803 32167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:19.680567 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 32092
I20260811 07:31:19.680699 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:19.681095 12256 external_mini_cluster.cc:1428] Setting key 6f0008d091e5f426bc45eeda801ed5b6
I20260811 07:31:19.685171 32167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: Bootstrap starting.
I20260811 07:31:19.687673 32167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:19.688542 32167 log.cc:824] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:19.690784 32167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: No bootstrap required, opened a new log
I20260811 07:31:19.691999 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.682802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.11.248.62:44383)
0811 07:31:19.683627 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.683645 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.683687 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:31:19.684427 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.684446 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.684996 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.685387 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:19.685881 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.687013 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.688138 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.688722 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.688973 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.690029 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:19.690035 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:19.690050 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:19.690500 (+ 450us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:19.690565 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:19.690588 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:19.690714 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.690852 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.691188 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":171,"threads_started":1}
I20260811 07:31:19.695189 32167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e036801e6440d9b51eda65dc7503a9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44383 } }
I20260811 07:31:19.695483 32167 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:19.695585 32167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e036801e6440d9b51eda65dc7503a9, State: Initialized, Role: FOLLOWER
I20260811 07:31:19.696122 32167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e036801e6440d9b51eda65dc7503a9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44383 } }
I20260811 07:31:19.696290 32167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:19.696357 32167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:19.696455 32167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:19.697592 32167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e036801e6440d9b51eda65dc7503a9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44383 } }
I20260811 07:31:19.697912 32167 leader_election.cc:302] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66e036801e6440d9b51eda65dc7503a9; no voters:
I20260811 07:31:19.698212 32167 leader_election.cc:288] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:19.698547 32172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:19.698875 32172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [term 1 LEADER]: Becoming Leader. State: Replica: 66e036801e6440d9b51eda65dc7503a9, State: Running, Role: LEADER
I20260811 07:31:19.699265 32172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e036801e6440d9b51eda65dc7503a9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44383 } }
I20260811 07:31:19.699615 32167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:19.701020 32174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66e036801e6440d9b51eda65dc7503a9. Latest consensus state: current_term: 1 leader_uuid: "66e036801e6440d9b51eda65dc7503a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e036801e6440d9b51eda65dc7503a9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44383 } } }
I20260811 07:31:19.701193 32174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:19.701609 32173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66e036801e6440d9b51eda65dc7503a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e036801e6440d9b51eda65dc7503a9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44383 } } }
I20260811 07:31:19.701717 32173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9 [sys.catalog]: This master's current role is: LEADER
W20260811 07:31:19.705637 32188 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:19.705766 32188 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:19.705960 32184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:19.706974 32184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:19.713451 32184 catalog_manager.cc:1347] Generated new cluster ID: 4e7ddb4c8744405ea52bcc6434968e48
I20260811 07:31:19.713548 32184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:19.747251 32184 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:19.748390 32184 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:19.758201 32184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: Generated new TSK 0
I20260811 07:31:19.759231 32184 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:19.773268 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44383
--builtin_ntp_servers=127.11.248.20:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:31:19.908093 32193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:19.908437 32193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:19.908480 32193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:19.913036 32193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:19.913153 32193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:19.913482 32193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:19.919062 32193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:19.920396 32193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:19.922098 32193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:19.933223 32203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:19.933223 32206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:19.933243 32202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:19.933501 32193 server_base.cc:1034] running on GCE node
I20260811 07:31:19.934072 32193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:19.934863 32193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:19.936062 32193 hybrid_clock.cc:648] HybridClock initialized: now 1786433479936044 us; error 30 us; skew 500 ppm
I20260811 07:31:19.938611 32193 webserver.cc:460] Webserver started at http://127.11.248.1:38613/ using document root <none> and password file <none>
I20260811 07:31:19.939324 32193 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:19.939455 32193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:19.939721 32193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:19.942185 32193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "16550a4120fd4be2bcff4e3a84605084"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "53d9bdcd9d14b93fe07ddf6f63d4c818"
server_key_iv: "88bc690ba0ca4da38599aa3e6c5cca04"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.942857 32193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "16550a4120fd4be2bcff4e3a84605084"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "53d9bdcd9d14b93fe07ddf6f63d4c818"
server_key_iv: "88bc690ba0ca4da38599aa3e6c5cca04"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.947798 32193 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:31:19.951152 32215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.952754 32193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:31:19.952978 32193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "16550a4120fd4be2bcff4e3a84605084"
format_stamp: "Formatted at 2026-08-11 07:31:19 on dist-test-slave-77v9"
server_key: "53d9bdcd9d14b93fe07ddf6f63d4c818"
server_key_iv: "88bc690ba0ca4da38599aa3e6c5cca04"
server_key_version: "encryptionkey@0"
I20260811 07:31:19.953119 32193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:19.967200 32193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:19.968123 32193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:19.968376 32193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:19.969208 32193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:19.970337 32193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:19.970391 32193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.970469 32193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:19.970504 32193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:19.981130 32193 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:42373
I20260811 07:31:19.981153 32344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:42373 every 8 connection(s)
I20260811 07:31:19.982257 32193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:19.982643 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 32193
I20260811 07:31:19.982798 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:31:19.983186 12256 external_mini_cluster.cc:1428] Setting key 79f397e7b73e9315ca57f54549fee232
I20260811 07:31:19.985837 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44383
--builtin_ntp_servers=127.11.248.20:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:31:19.994264 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.984631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:58243 (local address 127.11.248.62:44383)
0811 07:31:19.984789 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:19.984794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:19.986267 (+ 1473us) server_negotiation.cc:407] Connection header received
0811 07:31:19.987826 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:19.987829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:19.987892 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:19.988007 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:19.989054 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.989931 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.991476 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.991900 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.992039 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.993460 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:19.993467 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:19.993474 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:19.993495 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:19.993527 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:19.993541 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:19.993647 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:19.993908 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 07:31:19.994017 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:31:19.995314 32349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:19.985245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44383 (local address 127.11.248.1:58243)
0811 07:31:19.986079 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:19.986136 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:19.987583 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:19.988201 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:19.988209 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:19.988302 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:19.988890 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.988913 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.990112 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.990115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.991311 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:19.991322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:19.992097 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:19.992101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:19.992288 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:19.993116 (+ 828us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:19.993118 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:19.993166 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:19.993252 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:19.993677 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:19.993688 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:19.993694 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:31:19.993835 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 07:31:19.994148 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":156,"threads_started":1}
I20260811 07:31:19.997026 32346 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44383
I20260811 07:31:19.997349 32346 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:19.998137 32346 heartbeater.cc:511] Master 127.11.248.62:44383 requested a full tablet report, sending...
I20260811 07:31:20.000133 32128 ts_manager.cc:194] Registered new tserver with Master: 16550a4120fd4be2bcff4e3a84605084 (127.11.248.1:42373)
I20260811 07:31:20.001538 32128 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.1:58243
W20260811 07:31:20.116539 32350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:20.116969 32350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:20.117053 32350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:20.121356 32350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:20.121487 32350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:20.121606 32350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:20.127056 32350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:20.128381 32350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:20.129940 32350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:20.141109 32358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:20.141127 32356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:20.141202 32350 server_base.cc:1034] running on GCE node
W20260811 07:31:20.141141 32355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:20.141968 32350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:20.142773 32350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:20.144009 32350 hybrid_clock.cc:648] HybridClock initialized: now 1786433480143987 us; error 35 us; skew 500 ppm
I20260811 07:31:20.146432 32350 webserver.cc:460] Webserver started at http://127.11.248.2:41487/ using document root <none> and password file <none>
I20260811 07:31:20.147182 32350 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:20.147307 32350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:20.147547 32350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:20.150177 32350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c"
format_stamp: "Formatted at 2026-08-11 07:31:20 on dist-test-slave-77v9"
server_key: "217bca4686730cbc7250a4a723d7fce8"
server_key_iv: "1dc861b6509ba98361e5edaeeb67d1c2"
server_key_version: "encryptionkey@0"
I20260811 07:31:20.150938 32350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c"
format_stamp: "Formatted at 2026-08-11 07:31:20 on dist-test-slave-77v9"
server_key: "217bca4686730cbc7250a4a723d7fce8"
server_key_iv: "1dc861b6509ba98361e5edaeeb67d1c2"
server_key_version: "encryptionkey@0"
I20260811 07:31:20.155495 32350 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:20.159144 32364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:20.160715 32350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:31:20.161043 32350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c"
format_stamp: "Formatted at 2026-08-11 07:31:20 on dist-test-slave-77v9"
server_key: "217bca4686730cbc7250a4a723d7fce8"
server_key_iv: "1dc861b6509ba98361e5edaeeb67d1c2"
server_key_version: "encryptionkey@0"
I20260811 07:31:20.161222 32350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:20.177752 32350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:20.178604 32350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:20.178871 32350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:20.179672 32350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:20.180801 32350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:20.180953 32350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:20.181031 32350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:20.181080 32350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:20.191898 32350 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:45165
I20260811 07:31:20.191943 32494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:45165 every 8 connection(s)
I20260811 07:31:20.193151 32350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:20.195736 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 32350
I20260811 07:31:20.195876 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:31:20.196215 12256 external_mini_cluster.cc:1428] Setting key 0b51e06cac592696587a8e8d09fdd6c2
I20260811 07:31:20.198990 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44383
--builtin_ntp_servers=127.11.248.20:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:31:20.206533 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.195522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:44701 (local address 127.11.248.62:44383)
0811 07:31:20.195681 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.195685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.197372 (+ 1687us) server_negotiation.cc:407] Connection header received
0811 07:31:20.199386 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.199391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.199455 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.199558 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:20.201125 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.201777 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.203734 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.204017 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.204133 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.205908 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:20.205912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:20.205915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:20.205933 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:20.205958 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:20.205967 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:20.206042 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.206280 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.206378 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:31:20.208076 32497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.196068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44383 (local address 127.11.248.2:44701)
0811 07:31:20.197216 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.197264 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.199051 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.199844 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.199858 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.200001 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:20.200912 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.200949 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.201927 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.201933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.203561 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.203578 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.204235 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.204242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.204556 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.205457 (+ 901us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:20.205461 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:20.205536 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:20.205659 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:20.206079 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:20.206093 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:20.206103 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.206264 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.206705 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":173,"threads_started":1}
I20260811 07:31:20.209888 32495 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44383
I20260811 07:31:20.210209 32495 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:20.210942 32495 heartbeater.cc:511] Master 127.11.248.62:44383 requested a full tablet report, sending...
I20260811 07:31:20.212368 32128 ts_manager.cc:194] Registered new tserver with Master: 6e4c8b9faecc4e4fb03fdec26b983e4c (127.11.248.2:45165)
I20260811 07:31:20.213398 32128 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.2:44701
W20260811 07:31:20.333094 32498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:20.333434 32498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:20.333482 32498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:20.338459 32498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:20.338544 32498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:20.338611 32498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:20.344499 32498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:20.345749 32498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:20.347347 32498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:20.358672 32505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:20.358672 32507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:20.358661 32504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:20.359369 32498 server_base.cc:1034] running on GCE node
I20260811 07:31:20.359911 32498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:20.360711 32498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:20.361948 32498 hybrid_clock.cc:648] HybridClock initialized: now 1786433480361930 us; error 37 us; skew 500 ppm
I20260811 07:31:20.364337 32498 webserver.cc:460] Webserver started at http://127.11.248.3:42879/ using document root <none> and password file <none>
I20260811 07:31:20.365154 32498 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:20.365285 32498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:20.365573 32498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:20.368230 32498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "beff83e100db4ffaa00b63efae112fc9"
format_stamp: "Formatted at 2026-08-11 07:31:20 on dist-test-slave-77v9"
server_key: "5ad3da678a698c7aa458d1d90248421a"
server_key_iv: "b1b2172671c6aae4027e44b273335f93"
server_key_version: "encryptionkey@0"
I20260811 07:31:20.369019 32498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "beff83e100db4ffaa00b63efae112fc9"
format_stamp: "Formatted at 2026-08-11 07:31:20 on dist-test-slave-77v9"
server_key: "5ad3da678a698c7aa458d1d90248421a"
server_key_iv: "b1b2172671c6aae4027e44b273335f93"
server_key_version: "encryptionkey@0"
I20260811 07:31:20.373641 32498 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:31:20.376737 32513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:20.378342 32498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260811 07:31:20.378582 32498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "beff83e100db4ffaa00b63efae112fc9"
format_stamp: "Formatted at 2026-08-11 07:31:20 on dist-test-slave-77v9"
server_key: "5ad3da678a698c7aa458d1d90248421a"
server_key_iv: "b1b2172671c6aae4027e44b273335f93"
server_key_version: "encryptionkey@0"
I20260811 07:31:20.378742 32498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:20.399374 32498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:20.400290 32498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:20.400610 32498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:20.401454 32498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:20.402648 32498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:20.402736 32498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:20.402808 32498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:20.402865 32498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:20.413866 32498 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39313
I20260811 07:31:20.413897 32642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39313 every 8 connection(s)
I20260811 07:31:20.414980 32498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:20.419904 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 32498
I20260811 07:31:20.420082 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:31:20.420444 12256 external_mini_cluster.cc:1428] Setting key 70f9f04da043a6508e72fbf328626830
I20260811 07:31:20.426640 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.417203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:38731 (local address 127.11.248.62:44383)
0811 07:31:20.417390 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.417394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.418618 (+ 1224us) server_negotiation.cc:407] Connection header received
0811 07:31:20.420574 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.420581 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.420653 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.420729 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:20.422074 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.422878 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.424183 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.424562 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.424673 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.426075 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:20.426079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:20.426081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:20.426104 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:20.426126 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:20.426134 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:20.426214 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.426394 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.426483 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:31:20.427639 32645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.417664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44383 (local address 127.11.248.3:38731)
0811 07:31:20.418425 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.418471 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.420219 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.420994 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.421002 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.421151 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:20.421902 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.421923 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.423031 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.423033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.424036 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.424045 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.424725 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.424729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.425039 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.425765 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:20.425767 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:20.425813 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:20.425888 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:20.426216 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:20.426228 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:20.426235 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.426382 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.426719 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":152,"threads_started":1}
I20260811 07:31:20.429375 32643 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44383
I20260811 07:31:20.429661 32643 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:20.430265 32643 heartbeater.cc:511] Master 127.11.248.62:44383 requested a full tablet report, sending...
I20260811 07:31:20.431465 32128 ts_manager.cc:194] Registered new tserver with Master: beff83e100db4ffaa00b63efae112fc9 (127.11.248.3:39313)
I20260811 07:31:20.432250 32128 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.3:38731
I20260811 07:31:20.435123 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:31:20.441776 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.437481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.11.248.62:44383)
0811 07:31:20.437628 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.437632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.437806 (+ 174us) server_negotiation.cc:407] Connection header received
0811 07:31:20.437922 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.437924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.437964 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.438048 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:20.438300 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.438818 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.439739 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.440066 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.440157 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.441260 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:20.441264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:20.441266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:20.441281 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:20.441301 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:20.441309 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:20.441380 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.441567 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.441635 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:31:20.445703 32128 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:31:20.449244 32128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:31:20.466812 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.460703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42373 (local address 127.0.0.1:57354)
0811 07:31:20.461418 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.461431 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.461502 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.462235 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.462238 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.462254 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:20.462334 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.462339 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.463680 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.463684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.464919 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.464929 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.466198 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.466203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.466303 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.466370 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.466499 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.466660 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":129,"threads_started":1}
I20260811 07:31:20.466848 32662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.460923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57354 (local address 127.11.248.1:42373)
0811 07:31:20.461749 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.461756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.461781 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:31:20.461860 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.461865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.462048 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.462244 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:20.462474 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.463548 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.465090 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.466004 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.466143 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.466354 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.466555 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.466674 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":90,"threads_started":1}
I20260811 07:31:20.467741 32657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.459838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39313 (local address 127.0.0.1:50428)
0811 07:31:20.460768 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.460855 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.461017 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.461764 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.461771 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.461795 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:20.461965 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.461972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.463232 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.463237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.465004 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.465012 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.467323 (+ 2311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.467327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.467432 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.467458 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.467534 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.467608 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"mutex_wait_us":121,"thread_start_us":152,"threads_started":1}
I20260811 07:31:20.468159 32661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.459931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:45165 (local address 127.0.0.1:48876)
0811 07:31:20.461052 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.461066 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.461141 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.461901 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.461904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.461917 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:20.461999 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.462007 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.463498 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.463502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.465000 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.465012 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.467720 (+ 2708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.467728 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.467841 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.467865 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.467950 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.468018 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":102,"thread_start_us":113,"threads_started":1}
I20260811 07:31:20.468370 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.460156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.11.248.3:39313)
0811 07:31:20.460594 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.460609 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.461242 (+ 633us) server_negotiation.cc:407] Connection header received
0811 07:31:20.461342 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.461348 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.461570 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.462133 (+ 563us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:20.462319 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.463102 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.465121 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.465998 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.466130 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.466354 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.468043 (+ 1689us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.468159 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":155,"threads_started":1}
I20260811 07:31:20.468668 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.460631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.11.248.2:45165)
0811 07:31:20.461310 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.461324 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.461344 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:31:20.461418 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.461423 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.461569 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.461740 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:20.462144 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.463339 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.466445 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.467256 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.467409 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.467601 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.468399 (+ 798us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.468511 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":119,"threads_started":1}
I20260811 07:31:20.470323 32269 tablet_service.cc:1467] Processing CreateTablet for tablet af1269ba2cd34837a69cf543165891cf (DEFAULT_TABLE table=test-table [id=be7962a3c307469e8dc4377321f96d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:20.471221 32418 tablet_service.cc:1467] Processing CreateTablet for tablet af1269ba2cd34837a69cf543165891cf (DEFAULT_TABLE table=test-table [id=be7962a3c307469e8dc4377321f96d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:20.471575 32269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af1269ba2cd34837a69cf543165891cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:20.472267 32418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af1269ba2cd34837a69cf543165891cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:20.473874 32569 tablet_service.cc:1467] Processing CreateTablet for tablet af1269ba2cd34837a69cf543165891cf (DEFAULT_TABLE table=test-table [id=be7962a3c307469e8dc4377321f96d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:20.475023 32569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af1269ba2cd34837a69cf543165891cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:20.478924 32663 tablet_bootstrap.cc:492] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Bootstrap starting.
I20260811 07:31:20.480875 32664 tablet_bootstrap.cc:492] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084: Bootstrap starting.
I20260811 07:31:20.482160 32663 tablet_bootstrap.cc:654] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:20.483148 32663 log.cc:824] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:20.483338 32664 tablet_bootstrap.cc:654] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:20.483363 32666 tablet_bootstrap.cc:492] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Bootstrap starting.
I20260811 07:31:20.484282 32664 log.cc:824] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:20.485798 32663 tablet_bootstrap.cc:492] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: No bootstrap required, opened a new log
I20260811 07:31:20.486044 32666 tablet_bootstrap.cc:654] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:20.486040 32663 ts_tablet_manager.cc:1397] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:31:20.486549 32664 tablet_bootstrap.cc:492] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084: No bootstrap required, opened a new log
I20260811 07:31:20.486764 32664 ts_tablet_manager.cc:1397] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:31:20.487193 32666 log.cc:824] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:20.490734 32666 tablet_bootstrap.cc:492] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: No bootstrap required, opened a new log
I20260811 07:31:20.491021 32666 ts_tablet_manager.cc:1397] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260811 07:31:20.491268 32663 raft_consensus.cc:348] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.491269 32664 raft_consensus.cc:348] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.491613 32663 raft_consensus.cc:374] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:20.491613 32664 raft_consensus.cc:374] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:20.491690 32663 raft_consensus.cc:729] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4c8b9faecc4e4fb03fdec26b983e4c, State: Initialized, Role: FOLLOWER
I20260811 07:31:20.491689 32664 raft_consensus.cc:729] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16550a4120fd4be2bcff4e3a84605084, State: Initialized, Role: FOLLOWER
I20260811 07:31:20.492235 32663 consensus_queue.cc:260] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.492235 32664 consensus_queue.cc:260] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.493076 32346 heartbeater.cc:503] Master 127.11.248.62:44383 was elected leader, sending a full tablet report...
I20260811 07:31:20.493459 32663 ts_tablet_manager.cc:1428] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Time spent starting tablet: real 0.007s user 0.002s sys 0.006s
I20260811 07:31:20.493459 32664 ts_tablet_manager.cc:1428] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:31:20.493834 32670 raft_consensus.cc:482] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:20.493911 32495 heartbeater.cc:503] Master 127.11.248.62:44383 was elected leader, sending a full tablet report...
I20260811 07:31:20.493968 32670 raft_consensus.cc:504] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.496060 32666 raft_consensus.cc:348] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.496434 32666 raft_consensus.cc:374] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:20.496500 32666 raft_consensus.cc:729] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: beff83e100db4ffaa00b63efae112fc9, State: Initialized, Role: FOLLOWER
I20260811 07:31:20.497045 32666 consensus_queue.cc:260] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.497331 32670 leader_election.cc:288] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers beff83e100db4ffaa00b63efae112fc9 (127.11.248.3:39313), 16550a4120fd4be2bcff4e3a84605084 (127.11.248.1:42373)
I20260811 07:31:20.498344 32666 ts_tablet_manager.cc:1428] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:31:20.498757 32643 heartbeater.cc:503] Master 127.11.248.62:44383 was elected leader, sending a full tablet report...
I20260811 07:31:20.499866 32497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.495364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39313 (local address 127.11.248.2:44989)
0811 07:31:20.495555 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.495572 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.495669 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.496119 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.496123 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.496143 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:20.496271 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.496279 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.497324 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.497327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.498383 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.498394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.499392 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.499396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.499511 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.499536 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.499612 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.499702 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 07:31:20.500514 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.495557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:44989 (local address 127.11.248.3:39313)
0811 07:31:20.495687 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.495691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.495712 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:31:20.495792 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.495794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.495841 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.495927 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:20.496432 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.497188 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.498537 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.499146 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.499266 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.499316 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.500287 (+ 971us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.500400 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:31:20.501418 32592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af1269ba2cd34837a69cf543165891cf" candidate_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "beff83e100db4ffaa00b63efae112fc9" is_pre_election: true
I20260811 07:31:20.501757 32592 raft_consensus.cc:2454] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4c8b9faecc4e4fb03fdec26b983e4c in term 0.
I20260811 07:31:20.502357 32367 leader_election.cc:302] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4c8b9faecc4e4fb03fdec26b983e4c, beff83e100db4ffaa00b63efae112fc9; no voters:
I20260811 07:31:20.502689 32670 raft_consensus.cc:2781] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:31:20.502810 32670 raft_consensus.cc:482] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:31:20.502871 32670 raft_consensus.cc:3037] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:20.504168 32497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.497937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42373 (local address 127.11.248.2:41333)
0811 07:31:20.500050 (+ 2113us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.500065 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:20.500151 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:20.500514 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:20.500517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:20.500537 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:20.500624 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.500634 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.501795 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.501799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.502796 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:20.502805 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.503710 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.503713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:20.503780 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.503899 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 07:31:20.503989 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:31:20.504055 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2055,"thread_start_us":104,"threads_started":1}
I20260811 07:31:20.504276 32662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.498036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:41333 (local address 127.11.248.1:42373)
0811 07:31:20.498160 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.498165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.500210 (+ 2045us) server_negotiation.cc:407] Connection header received
0811 07:31:20.500268 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.500271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.500334 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.500406 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:20.500954 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.501654 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.502945 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.503561 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.503696 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.503745 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.504028 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.504109 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:31:20.504387 32670 raft_consensus.cc:504] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.504920 32291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af1269ba2cd34837a69cf543165891cf" candidate_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16550a4120fd4be2bcff4e3a84605084" is_pre_election: true
I20260811 07:31:20.504997 32670 leader_election.cc:288] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [CANDIDATE]: Term 1 election: Requested vote from peers beff83e100db4ffaa00b63efae112fc9 (127.11.248.3:39313), 16550a4120fd4be2bcff4e3a84605084 (127.11.248.1:42373)
I20260811 07:31:20.505126 32592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af1269ba2cd34837a69cf543165891cf" candidate_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "beff83e100db4ffaa00b63efae112fc9"
I20260811 07:31:20.505245 32592 raft_consensus.cc:3037] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:20.505265 32291 raft_consensus.cc:2454] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4c8b9faecc4e4fb03fdec26b983e4c in term 0.
I20260811 07:31:20.505402 32290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af1269ba2cd34837a69cf543165891cf" candidate_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16550a4120fd4be2bcff4e3a84605084"
I20260811 07:31:20.505504 32290 raft_consensus.cc:3037] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:20.506664 32592 raft_consensus.cc:2454] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4c8b9faecc4e4fb03fdec26b983e4c in term 1.
I20260811 07:31:20.506852 32290 raft_consensus.cc:2454] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4c8b9faecc4e4fb03fdec26b983e4c in term 1.
I20260811 07:31:20.507072 32367 leader_election.cc:302] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4c8b9faecc4e4fb03fdec26b983e4c, beff83e100db4ffaa00b63efae112fc9; no voters:
I20260811 07:31:20.507282 32670 raft_consensus.cc:2781] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:20.507424 32670 raft_consensus.cc:686] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 1 LEADER]: Becoming Leader. State: Replica: 6e4c8b9faecc4e4fb03fdec26b983e4c, State: Running, Role: LEADER
I20260811 07:31:20.507762 32670 consensus_queue.cc:237] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } }
I20260811 07:31:20.511704 32127 catalog_manager.cc:5495] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4c8b9faecc4e4fb03fdec26b983e4c (127.11.248.2). New cstate: current_term: 1 leader_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4c8b9faecc4e4fb03fdec26b983e4c" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 45165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 } health_report { overall_health: UNKNOWN } } }
I20260811 07:31:20.526780 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.522823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.11.248.2:45165)
0811 07:31:20.523095 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:20.523102 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:20.523119 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:31:20.523214 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:20.523217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:20.523275 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:20.523401 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:31:20.523664 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.524175 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.525146 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:20.525367 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:20.525485 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:20.525824 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:31:20.526287 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:31:20.526434 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:20.526527 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 07:31:20.526592 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260811 07:31:20.533771 32290 raft_consensus.cc:1261] T af1269ba2cd34837a69cf543165891cf P 16550a4120fd4be2bcff4e3a84605084 [term 1 FOLLOWER]: Refusing update from remote peer 6e4c8b9faecc4e4fb03fdec26b983e4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:20.533771 32592 raft_consensus.cc:1261] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 1 FOLLOWER]: Refusing update from remote peer 6e4c8b9faecc4e4fb03fdec26b983e4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:20.534690 32671 consensus_queue.cc:1035] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16550a4120fd4be2bcff4e3a84605084" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 42373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:20.534983 32670 consensus_queue.cc:1035] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "beff83e100db4ffaa00b63efae112fc9" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:20.544756 32680 mvcc.cc:205] Tried to move back new op lower bound from 7317231536257404928 to 7317231536163246080. Current Snapshot: MvccSnapshot[applied={T|T < 7317231536257404928}]
I20260811 07:31:20.544763 32682 mvcc.cc:205] Tried to move back new op lower bound from 7317231536257404928 to 7317231536163246080. Current Snapshot: MvccSnapshot[applied={T|T < 7317231536257404928}]
I20260811 07:31:20.554579 32129 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:20.554787 32129 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:20.558125 32129 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66e036801e6440d9b51eda65dc7503a9: Sending DeleteTablet for 3 replicas of tablet af1269ba2cd34837a69cf543165891cf
I20260811 07:31:20.559218 32418 tablet_service.cc:1514] Processing DeleteTablet for tablet af1269ba2cd34837a69cf543165891cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:20 UTC) from {username='slave'} at 127.0.0.1:48876
I20260811 07:31:20.559211 32569 tablet_service.cc:1514] Processing DeleteTablet for tablet af1269ba2cd34837a69cf543165891cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:20 UTC) from {username='slave'} at 127.0.0.1:50428
I20260811 07:31:20.559883 32692 tablet_replica.cc:330] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: stopping tablet replica
I20260811 07:31:20.559880 32269 tablet_service.cc:1514] Processing DeleteTablet for tablet af1269ba2cd34837a69cf543165891cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:20 UTC) from {username='slave'} at 127.0.0.1:57354
I20260811 07:31:20.560230 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 32193
I20260811 07:31:20.560313 32692 raft_consensus.cc:2229] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:31:20.562500 32692 raft_consensus.cc:2258] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:20.565056 32692 ts_tablet_manager.cc:1905] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:20.565403 32690 tablet_replica.cc:330] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: stopping tablet replica
I20260811 07:31:20.565793 32690 raft_consensus.cc:2229] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:20.566164 32690 raft_consensus.cc:2258] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:20.568537 32692 ts_tablet_manager.cc:1918] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:20.568702 32692 log.cc:1196] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/af1269ba2cd34837a69cf543165891cf
I20260811 07:31:20.569192 32692 ts_tablet_manager.cc:1939] T af1269ba2cd34837a69cf543165891cf P 6e4c8b9faecc4e4fb03fdec26b983e4c: Deleting consensus metadata
I20260811 07:31:20.570587 32114 catalog_manager.cc:4841] TS 6e4c8b9faecc4e4fb03fdec26b983e4c (127.11.248.2:45165): tablet af1269ba2cd34837a69cf543165891cf (table test-table [id=be7962a3c307469e8dc4377321f96d09]) successfully deleted
W20260811 07:31:20.572731 32115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:42373 (error 108)
I20260811 07:31:20.573694 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 32350
I20260811 07:31:20.578068 32690 ts_tablet_manager.cc:1905] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:20.581036 32690 ts_tablet_manager.cc:1918] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:20.581209 32690 log.cc:1196] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/af1269ba2cd34837a69cf543165891cf
I20260811 07:31:20.581571 32690 ts_tablet_manager.cc:1939] T af1269ba2cd34837a69cf543165891cf P beff83e100db4ffaa00b63efae112fc9: Deleting consensus metadata
I20260811 07:31:20.581843 32661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:20.581373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:42373 (local address 127.0.0.1:57366)
0811 07:31:20.581600 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:20.581716 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:42373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 07:31:20.582082 32115 catalog_manager.cc:4584] TS 16550a4120fd4be2bcff4e3a84605084 (127.11.248.1:42373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet af1269ba2cd34837a69cf543165891cf: Network error: Client connection negotiation failed: client connection to 127.11.248.1:42373: connect: Connection refused (error 111)
I20260811 07:31:20.583137 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 32498
I20260811 07:31:20.583143 32112 catalog_manager.cc:4841] TS beff83e100db4ffaa00b63efae112fc9 (127.11.248.3:39313): tablet af1269ba2cd34837a69cf543165891cf (table test-table [id=be7962a3c307469e8dc4377321f96d09]) successfully deleted
I20260811 07:31:20.591534 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 32092
2026-08-11T07:31:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1149 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:20 dist-test-slave-77v9 krb5kdc[32698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:20 dist-test-slave-77v9 krb5kdc[32698](info): set up 2 sockets
Aug 11 07:31:20 dist-test-slave-77v9 krb5kdc[32698](info): commencing operation
krb5kdc: starting...
W20260811 07:31:21.766359 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:21 dist-test-slave-77v9 krb5kdc[32698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:21.920457 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36353
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:44881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:22.044239 32714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:22.044576 32714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:22.044620 32714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:22.049027 32714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:22.049118 32714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:22.049139 32714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:22.049157 32714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:22.049175 32714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:22.055001 32714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:44881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:22.056211 32714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:22.057389 32714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:22.067687 32723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.067694 32720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.067719 32721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:22.067833 32714 server_base.cc:1034] running on GCE node
I20260811 07:31:22.068660 32714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:22.070029 32714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:22.071226 32714 hybrid_clock.cc:648] HybridClock initialized: now 1786433482071196 us; error 45 us; skew 500 ppm
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:22.078364 32714 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:22.079759 32714 webserver.cc:460] Webserver started at http://127.11.248.62:37343/ using document root <none> and password file <none>
I20260811 07:31:22.080457 32714 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:22.080575 32714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:22.080909 32714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:22.083518 32714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "fc732515fea6496aac04810f7c81dd35"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "93520f9792cf924a2243395200a86419"
server_key_iv: "27a2022cfbe71eabfa7d0e36b45f0793"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.084229 32714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "fc732515fea6496aac04810f7c81dd35"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "93520f9792cf924a2243395200a86419"
server_key_iv: "27a2022cfbe71eabfa7d0e36b45f0793"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.089066 32714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.002s
I20260811 07:31:22.092116 32731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.093770 32714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:22.093979 32714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "fc732515fea6496aac04810f7c81dd35"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "93520f9792cf924a2243395200a86419"
server_key_iv: "27a2022cfbe71eabfa7d0e36b45f0793"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.094149 32714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:22.111672 32714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:22.115428 32714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:22.115701 32714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:22.124853 32714 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:36353
I20260811 07:31:22.124895 323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:36353 every 8 connection(s)
I20260811 07:31:22.126019 32714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:22.129395 324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:22.129828 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 32714
I20260811 07:31:22.130044 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:22.130400 12256 external_mini_cluster.cc:1428] Setting key b97825bdb8e5b860086913782a824e33
I20260811 07:31:22.137491 324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35: Bootstrap starting.
I20260811 07:31:22.140470 324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:22.141547 324 log.cc:824] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:22.144377 324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35: No bootstrap required, opened a new log
I20260811 07:31:22.148531 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.132138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42040 (local address 127.11.248.62:36353)
0811 07:31:22.132689 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.132709 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.132759 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:31:22.133684 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.133712 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.134196 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.134619 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:22.135549 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.137152 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.138293 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.139038 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.139226 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.142444 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:22.142454 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:22.142480 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:22.142521 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:22.144877 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.145517 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.145523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.145528 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.145664 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.146040 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.146043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.146045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.146593 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:22.146778 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:22.147249 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 07:31:22.147668 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":172,"threads_started":1}
I20260811 07:31:22.148967 324 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc732515fea6496aac04810f7c81dd35" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36353 } }
I20260811 07:31:22.149210 324 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:22.149281 324 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc732515fea6496aac04810f7c81dd35, State: Initialized, Role: FOLLOWER
I20260811 07:31:22.149736 324 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc732515fea6496aac04810f7c81dd35" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36353 } }
I20260811 07:31:22.149907 324 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:22.149997 324 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:22.150122 324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:22.151166 324 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc732515fea6496aac04810f7c81dd35" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36353 } }
I20260811 07:31:22.151518 324 leader_election.cc:302] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc732515fea6496aac04810f7c81dd35; no voters:
I20260811 07:31:22.151858 324 leader_election.cc:288] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:22.152056 330 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:22.152338 330 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [term 1 LEADER]: Becoming Leader. State: Replica: fc732515fea6496aac04810f7c81dd35, State: Running, Role: LEADER
I20260811 07:31:22.152670 330 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc732515fea6496aac04810f7c81dd35" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36353 } }
I20260811 07:31:22.153244 324 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:22.154525 333 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc732515fea6496aac04810f7c81dd35. Latest consensus state: current_term: 1 leader_uuid: "fc732515fea6496aac04810f7c81dd35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc732515fea6496aac04810f7c81dd35" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36353 } } }
I20260811 07:31:22.154606 331 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc732515fea6496aac04810f7c81dd35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc732515fea6496aac04810f7c81dd35" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36353 } } }
I20260811 07:31:22.154706 331 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:22.154706 333 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:22.155256 343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:22.159171 343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:22.165835 343 catalog_manager.cc:1347] Generated new cluster ID: 33f79561719c4bd987877712dc2de4dd
I20260811 07:31:22.165946 343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:22.187165 343 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:22.188274 343 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:22.195466 343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35: Generated new TSK 0
I20260811 07:31:22.196416 343 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:31:22.241176 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36353
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:44881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:22.372550 359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:22.372965 359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:22.373054 359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:22.377338 359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:22.377477 359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:22.377585 359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:22.383448 359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:44881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:22.384711 359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:22.385963 359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:22.396951 368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.396952 365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.396972 366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:22.397301 359 server_base.cc:1034] running on GCE node
I20260811 07:31:22.397805 359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:22.398626 359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:22.399832 359 hybrid_clock.cc:648] HybridClock initialized: now 1786433482399819 us; error 30 us; skew 500 ppm
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:22.403373 359 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:31:22.404491 359 webserver.cc:460] Webserver started at http://127.11.248.1:35355/ using document root <none> and password file <none>
I20260811 07:31:22.405231 359 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:22.405345 359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:22.405622 359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:22.408094 359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "b0318dc8258e4654b44ca88cb3a4fd81"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "3073b16235bea321d78471c1154c736f"
server_key_iv: "c1824e1d9dae8da9705907002d1b7577"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.408762 359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "b0318dc8258e4654b44ca88cb3a4fd81"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "3073b16235bea321d78471c1154c736f"
server_key_iv: "c1824e1d9dae8da9705907002d1b7577"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.413340 359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:31:22.416183 377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.417716 359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:22.417893 359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "b0318dc8258e4654b44ca88cb3a4fd81"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "3073b16235bea321d78471c1154c736f"
server_key_iv: "c1824e1d9dae8da9705907002d1b7577"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.418046 359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:22.433897 359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:22.437839 359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:22.438100 359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:22.438796 359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:22.439776 359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:22.439862 359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.439940 359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:22.439989 359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.450254 359 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:44995
I20260811 07:31:22.450286 507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:44995 every 8 connection(s)
I20260811 07:31:22.451277 359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:22.452000 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 359
I20260811 07:31:22.452164 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:31:22.452539 12256 external_mini_cluster.cc:1428] Setting key 1a599b481f94890bfdae5beb3f665945
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:31:22.468125 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.453671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:46373 (local address 127.11.248.62:36353)
0811 07:31:22.453867 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.453873 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.455202 (+ 1329us) server_negotiation.cc:407] Connection header received
0811 07:31:22.456663 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.456667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.456726 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.456859 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:22.458161 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.458757 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.460116 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.460358 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.460432 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.463994 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:22.463998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:22.464000 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:22.464031 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:22.465765 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.466401 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.466429 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.466430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.466526 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.466916 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.466921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.466925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.467131 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:22.467247 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:22.467801 (+ 554us) server_negotiation.cc:299] Negotiation successful
0811 07:31:22.467953 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:31:22.469118 510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.454298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36353 (local address 127.11.248.1:46373)
0811 07:31:22.455049 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:22.455098 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:22.456428 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:22.457051 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:22.457058 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:22.457462 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:22.457990 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.458004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.458916 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.458925 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:22.459893 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.459936 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.460640 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.460642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:22.460859 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.461670 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:22.461689 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:22.463748 (+ 2059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:22.465927 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:22.465935 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:22.465972 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:22.466271 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:22.466637 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:22.466640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:22.466642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:22.466808 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:22.467248 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:22.467258 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:22.467546 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 07:31:22.467757 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 07:31:22.468138 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":203,"threads_started":1}
I20260811 07:31:22.470729 508 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36353
I20260811 07:31:22.471078 508 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:22.471741 508 heartbeater.cc:511] Master 127.11.248.62:36353 requested a full tablet report, sending...
I20260811 07:31:22.473687 32750 ts_manager.cc:194] Registered new tserver with Master: b0318dc8258e4654b44ca88cb3a4fd81 (127.11.248.1:44995)
I20260811 07:31:22.475714 32750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:46373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:31:22.494467 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36353
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:44881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:22.614675 513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:22.614996 513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:22.615043 513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:22.619639 513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:22.619732 513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:22.619801 513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:22.625875 513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:44881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:22.627050 513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:22.628103 513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:22.638257 518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.638257 519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.638656 521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:22.638725 513 server_base.cc:1034] running on GCE node
I20260811 07:31:22.639206 513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:22.639846 513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:22.641069 513 hybrid_clock.cc:648] HybridClock initialized: now 1786433482641057 us; error 26 us; skew 500 ppm
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:22.644249 513 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:31:22.645323 513 webserver.cc:460] Webserver started at http://127.11.248.2:42523/ using document root <none> and password file <none>
I20260811 07:31:22.645898 513 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:22.645963 513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:22.646142 513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:22.648510 513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "0d257cebc94940279ba5e474a2e668d6"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "966e4a5557b50a4d59c02a4ce15eb379"
server_key_iv: "8f8a05a3c3e74db30f726e968551ad83"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.649161 513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "0d257cebc94940279ba5e474a2e668d6"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "966e4a5557b50a4d59c02a4ce15eb379"
server_key_iv: "8f8a05a3c3e74db30f726e968551ad83"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.653410 513 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:22.656322 529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.657991 513 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:22.658150 513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "0d257cebc94940279ba5e474a2e668d6"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "966e4a5557b50a4d59c02a4ce15eb379"
server_key_iv: "8f8a05a3c3e74db30f726e968551ad83"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.658294 513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:22.677659 513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:22.681740 513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:22.682092 513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:22.682797 513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:22.683772 513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:22.683835 513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.683913 513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:22.683959 513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.694968 513 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:36885
I20260811 07:31:22.694973 653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:36885 every 8 connection(s)
I20260811 07:31:22.696218 513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:22.703696 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 513
I20260811 07:31:22.703943 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:31:22.704285 12256 external_mini_cluster.cc:1428] Setting key bc44607f7d9f206773ea0066cb749953
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:22.713917 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.698562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:43703 (local address 127.11.248.62:36353)
0811 07:31:22.698708 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.698712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.699757 (+ 1045us) server_negotiation.cc:407] Connection header received
0811 07:31:22.701316 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.701320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.701392 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.701504 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:22.702770 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.703315 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.704741 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.705115 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.705227 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.708897 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:22.708902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:22.708906 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:22.708950 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:22.710751 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.711673 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.711678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.711680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.711862 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.712381 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.712385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.712386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.712638 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:22.712748 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:22.713614 (+ 866us) server_negotiation.cc:299] Negotiation successful
0811 07:31:22.713765 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:31:22.715265 657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.699031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36353 (local address 127.11.248.2:43703)
0811 07:31:22.699592 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:22.699648 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:22.701078 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:22.701683 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:22.701690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:22.702109 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:22.702615 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.702628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.703466 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.703470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:22.704602 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.704613 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.705316 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.705322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:22.705566 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.706447 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:22.706475 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:22.708550 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:22.710937 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:22.710948 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:22.710972 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:22.711500 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:22.711991 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:22.711996 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:22.711998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:22.712236 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:22.712776 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:22.712786 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:22.713248 (+ 462us) client_negotiation.cc:769] Sending connection context
0811 07:31:22.713556 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 07:31:22.714009 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":152,"threads_started":1}
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:31:22.716718 654 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36353
I20260811 07:31:22.717048 654 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:22.717643 654 heartbeater.cc:511] Master 127.11.248.62:36353 requested a full tablet report, sending...
I20260811 07:31:22.719046 32750 ts_manager.cc:194] Registered new tserver with Master: 0d257cebc94940279ba5e474a2e668d6 (127.11.248.2:36885)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:31:22.719842 32750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:43703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:31:22.742357 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36353
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:44881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:22.865835 660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:22.866139 660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:22.866185 660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:22.870671 660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:22.870754 660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:22.870818 660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:22.876587 660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:44881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:36353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:22.877892 660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:22.878988 660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:22.889518 670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:22.889658 660 server_base.cc:1034] running on GCE node
W20260811 07:31:22.889518 667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:22.889521 668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:22.890358 660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:22.891131 660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:22.892334 660 hybrid_clock.cc:648] HybridClock initialized: now 1786433482892298 us; error 53 us; skew 500 ppm
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:22.895603 660 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:31:22.896888 660 webserver.cc:460] Webserver started at http://127.11.248.3:40395/ using document root <none> and password file <none>
I20260811 07:31:22.897536 660 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:22.897693 660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:22.897949 660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:22.900425 660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "80a9f631516b4b858659bf609e549610"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "7dc14526de00a29bac9cd2213ccb57ef"
server_key_iv: "0e516c4ba495b96d38c77c12e0f1e625"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.901137 660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "80a9f631516b4b858659bf609e549610"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "7dc14526de00a29bac9cd2213ccb57ef"
server_key_iv: "0e516c4ba495b96d38c77c12e0f1e625"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.905894 660 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:31:22.909029 677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.910621 660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:22.910755 660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "80a9f631516b4b858659bf609e549610"
format_stamp: "Formatted at 2026-08-11 07:31:22 on dist-test-slave-77v9"
server_key: "7dc14526de00a29bac9cd2213ccb57ef"
server_key_iv: "0e516c4ba495b96d38c77c12e0f1e625"
server_key_version: "encryptionkey@0"
I20260811 07:31:22.910957 660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:22.923640 660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:22.927587 660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:22.927876 660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:22.928627 660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:22.929715 660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:22.929771 660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.929845 660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:22.929898 660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:22.940929 660 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:41091
I20260811 07:31:22.940954 809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:41091 every 8 connection(s)
I20260811 07:31:22.942034 660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:22.952188 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 660
I20260811 07:31:22.952373 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:31:22.952759 12256 external_mini_cluster.cc:1428] Setting key 57eb6f0cf42a88b186b6f80b16e17dc5
Aug 11 07:31:22 dist-test-slave-77v9 krb5kdc[32698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433482, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:22.959807 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.944179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:47809 (local address 127.11.248.62:36353)
0811 07:31:22.944335 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.944338 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.945298 (+ 960us) server_negotiation.cc:407] Connection header received
0811 07:31:22.946961 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.946965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.947025 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.947123 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:22.948626 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.949332 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.950583 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.950922 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.951050 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.955280 (+ 4230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:22.955283 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:22.955286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:22.955317 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:22.957195 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.957940 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.957945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.957947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.958048 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.958478 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.958482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.958484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.958711 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:22.958840 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:22.959465 (+ 625us) server_negotiation.cc:299] Negotiation successful
0811 07:31:22.959620 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:31:22.960875 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.944585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:36353 (local address 127.11.248.3:47809)
0811 07:31:22.945107 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:22.945154 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:22.946647 (+ 1493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:22.947421 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:22.947439 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:22.947863 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:22.948440 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.948455 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.949488 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.949491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:22.950447 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.950456 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.951158 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.951163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:22.951438 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.952380 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:22.952409 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:22.955032 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:22.957369 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:22.957378 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:22.957400 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:22.957791 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:22.958164 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:22.958168 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:22.958170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:22.958360 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:22.958840 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:22.958850 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:22.959175 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 07:31:22.959413 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 07:31:22.959819 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":162,"threads_started":1}
I20260811 07:31:22.962262 810 heartbeater.cc:347] Connected to a master server at 127.11.248.62:36353
I20260811 07:31:22.962661 810 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:22.963315 810 heartbeater.cc:511] Master 127.11.248.62:36353 requested a full tablet report, sending...
I20260811 07:31:22.964689 32750 ts_manager.cc:194] Registered new tserver with Master: 80a9f631516b4b858659bf609e549610 (127.11.248.3:41091)
I20260811 07:31:22.965529 32750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:47809
I20260811 07:31:22.967625 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:31:22.978401 327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.970094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42044 (local address 127.11.248.62:36353)
0811 07:31:22.970246 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.970250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.970359 (+ 109us) server_negotiation.cc:407] Connection header received
0811 07:31:22.970488 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.970490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.970531 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.970611 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:22.971414 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.972024 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.972938 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.973172 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.973260 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:22.974937 (+ 1677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:22.974940 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:22.974942 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:22.974966 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:22.976289 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.976983 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.976986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.976988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.977071 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:22.977403 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:22.977405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:22.977407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:22.977631 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:22.977756 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:22.978134 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:31:22.978237 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:31:22.982196 32750 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42044:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:31:22.985644 32750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:31:23.003405 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.996769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44995 (local address 127.0.0.1:35478)
0811 07:31:22.997984 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:22.997997 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:22.998066 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:22.998769 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:22.998775 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:22.998796 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:22.998875 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.998882 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.000365 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.000368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.001566 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.001576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.002672 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.002675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.002768 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.002804 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:31:23.003055 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 07:31:23.003223 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1162,"mutex_wait_us":1,"thread_start_us":130,"threads_started":1}
I20260811 07:31:23.003468 829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.997284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35478 (local address 127.11.248.1:44995)
0811 07:31:22.998361 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.998367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.998389 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:31:22.998464 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.998468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.998647 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.998778 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:22.999005 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.000201 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.001705 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.002521 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.002643 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.002840 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.003099 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.003223 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":977,"thread_start_us":124,"threads_started":1}
I20260811 07:31:23.003865 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.996339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:36885 (local address 127.0.0.1:41588)
0811 07:31:22.997288 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:22.997350 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:22.997510 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:22.998244 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:22.998250 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:22.998273 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:22.998478 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.998486 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.000137 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.000140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.001928 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.001935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.003245 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.003249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.003366 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.003390 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:31:23.003470 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:31:23.003717 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":172,"thread_start_us":80,"threads_started":1}
I20260811 07:31:23.004421 827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.996568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:41091 (local address 127.0.0.1:41944)
0811 07:31:22.997672 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:22.997689 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:22.997784 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:22.998416 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:22.998419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:22.998438 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:22.998562 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:22.998572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.999960 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:22.999967 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.001909 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.001922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.004040 (+ 2118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.004044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.004151 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.004179 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:31:23.004229 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 07:31:23.004303 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":156,"thread_start_us":164,"threads_started":1}
I20260811 07:31:23.004657 826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.996551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41588 (local address 127.11.248.2:36885)
0811 07:31:22.997678 (+ 1127us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.997693 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.997724 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:31:22.997808 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.997813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.998059 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.998627 (+ 568us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:22.998811 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.999974 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.002065 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.002934 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.003043 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.003173 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.004278 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.004403 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1013,"thread_start_us":191,"threads_started":1}
I20260811 07:31:23.007251 432 tablet_service.cc:1467] Processing CreateTablet for tablet 9c8acea7b51c4c6aad0e995923a2c962 (DEFAULT_TABLE table=test-table [id=e03992d91ada47c08549a55bd6b0968e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:23.007504 581 tablet_service.cc:1467] Processing CreateTablet for tablet 9c8acea7b51c4c6aad0e995923a2c962 (DEFAULT_TABLE table=test-table [id=e03992d91ada47c08549a55bd6b0968e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:23.008581 830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:22.997288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.11.248.3:41091)
0811 07:31:22.997815 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:22.997828 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:22.997853 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:31:22.997954 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:22.997961 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:22.998179 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:22.998411 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:22.998718 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:22.999799 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.002944 (+ 3145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.003872 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.007942 (+ 4070us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.008184 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.008271 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.008405 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":204,"threads_started":1}
I20260811 07:31:23.008595 432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c8acea7b51c4c6aad0e995923a2c962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:23.008600 581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c8acea7b51c4c6aad0e995923a2c962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:23.011615 731 tablet_service.cc:1467] Processing CreateTablet for tablet 9c8acea7b51c4c6aad0e995923a2c962 (DEFAULT_TABLE table=test-table [id=e03992d91ada47c08549a55bd6b0968e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:23.012782 731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c8acea7b51c4c6aad0e995923a2c962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:23.017673 832 tablet_bootstrap.cc:492] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Bootstrap starting.
I20260811 07:31:23.017248 831 tablet_bootstrap.cc:492] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: Bootstrap starting.
I20260811 07:31:23.020296 832 tablet_bootstrap.cc:654] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:23.020632 831 tablet_bootstrap.cc:654] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:23.021374 832 log.cc:824] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:23.021695 833 tablet_bootstrap.cc:492] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Bootstrap starting.
I20260811 07:31:23.022521 831 log.cc:824] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:23.024223 833 tablet_bootstrap.cc:654] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:23.024703 832 tablet_bootstrap.cc:492] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: No bootstrap required, opened a new log
I20260811 07:31:23.024924 831 tablet_bootstrap.cc:492] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: No bootstrap required, opened a new log
I20260811 07:31:23.025040 832 ts_tablet_manager.cc:1397] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:31:23.025144 831 ts_tablet_manager.cc:1397] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:31:23.025662 833 log.cc:824] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:23.028132 833 tablet_bootstrap.cc:492] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: No bootstrap required, opened a new log
I20260811 07:31:23.028355 833 ts_tablet_manager.cc:1397] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:31:23.029511 832 raft_consensus.cc:348] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.029626 831 raft_consensus.cc:348] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.029824 832 raft_consensus.cc:374] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:23.029897 831 raft_consensus.cc:374] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:23.029902 832 raft_consensus.cc:729] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d257cebc94940279ba5e474a2e668d6, State: Initialized, Role: FOLLOWER
I20260811 07:31:23.029947 831 raft_consensus.cc:729] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0318dc8258e4654b44ca88cb3a4fd81, State: Initialized, Role: FOLLOWER
I20260811 07:31:23.030426 832 consensus_queue.cc:260] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.030453 831 consensus_queue.cc:260] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.031492 508 heartbeater.cc:503] Master 127.11.248.62:36353 was elected leader, sending a full tablet report...
I20260811 07:31:23.031665 832 ts_tablet_manager.cc:1428] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:31:23.031668 831 ts_tablet_manager.cc:1428] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:31:23.032100 654 heartbeater.cc:503] Master 127.11.248.62:36353 was elected leader, sending a full tablet report...
I20260811 07:31:23.032498 833 raft_consensus.cc:348] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.032832 833 raft_consensus.cc:374] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:23.032910 833 raft_consensus.cc:729] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a9f631516b4b858659bf609e549610, State: Initialized, Role: FOLLOWER
I20260811 07:31:23.033404 833 consensus_queue.cc:260] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.034114 810 heartbeater.cc:503] Master 127.11.248.62:36353 was elected leader, sending a full tablet report...
I20260811 07:31:23.035629 833 ts_tablet_manager.cc:1428] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260811 07:31:23.173329 838 raft_consensus.cc:482] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:23.173579 838 raft_consensus.cc:504] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.174814 838 leader_election.cc:288] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80a9f631516b4b858659bf609e549610 (127.11.248.3:41091), b0318dc8258e4654b44ca88cb3a4fd81 (127.11.248.1:44995)
I20260811 07:31:23.178926 830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.175271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:53133 (local address 127.11.248.3:41091)
0811 07:31:23.175423 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:23.175430 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:23.175549 (+ 119us) server_negotiation.cc:407] Connection header received
0811 07:31:23.175663 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:23.175666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:23.175740 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:23.175825 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:23.176126 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.176658 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.177898 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.178308 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.178450 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.178507 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.178710 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.178785 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:31:23.178929 657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.175072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44995 (local address 127.11.248.2:34089)
0811 07:31:23.175255 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:23.175271 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:23.175383 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:23.175744 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:23.175747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:23.175858 (+ 111us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:23.176016 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.176022 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.176794 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.176797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.177706 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.177715 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.178446 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.178449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.178600 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.178617 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 07:31:23.178714 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:31:23.178797 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":75,"spinlock_wait_cycles":19072}
I20260811 07:31:23.178946 829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.175354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:34089 (local address 127.11.248.1:44995)
0811 07:31:23.175487 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:23.175494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:23.175513 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:31:23.175574 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:23.175577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:23.175630 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:23.175710 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:23.176175 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.176663 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.177859 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.178307 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.178447 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.178506 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.178755 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.178835 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:31:23.178953 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.175072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:41091 (local address 127.11.248.2:53133)
0811 07:31:23.175437 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:23.175452 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:23.175567 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:23.175854 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:23.175856 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:23.175871 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:23.176009 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.176015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.176784 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.176797 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.177729 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.177738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.178446 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.178449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.178579 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.178600 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:31:23.178660 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 07:31:23.178767 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":145,"thread_start_us":98,"threads_started":1}
I20260811 07:31:23.179831 757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c8acea7b51c4c6aad0e995923a2c962" candidate_uuid: "0d257cebc94940279ba5e474a2e668d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80a9f631516b4b858659bf609e549610" is_pre_election: true
I20260811 07:31:23.179833 456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c8acea7b51c4c6aad0e995923a2c962" candidate_uuid: "0d257cebc94940279ba5e474a2e668d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" is_pre_election: true
I20260811 07:31:23.180159 757 raft_consensus.cc:2454] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d257cebc94940279ba5e474a2e668d6 in term 0.
I20260811 07:31:23.180169 456 raft_consensus.cc:2454] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d257cebc94940279ba5e474a2e668d6 in term 0.
I20260811 07:31:23.180721 533 leader_election.cc:302] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d257cebc94940279ba5e474a2e668d6, 80a9f631516b4b858659bf609e549610, b0318dc8258e4654b44ca88cb3a4fd81; no voters:
I20260811 07:31:23.181066 838 raft_consensus.cc:2781] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:31:23.181164 838 raft_consensus.cc:482] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:31:23.181208 838 raft_consensus.cc:3037] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:23.182284 838 raft_consensus.cc:504] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.182688 838 leader_election.cc:288] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [CANDIDATE]: Term 1 election: Requested vote from peers 80a9f631516b4b858659bf609e549610 (127.11.248.3:41091), b0318dc8258e4654b44ca88cb3a4fd81 (127.11.248.1:44995)
I20260811 07:31:23.183138 757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c8acea7b51c4c6aad0e995923a2c962" candidate_uuid: "0d257cebc94940279ba5e474a2e668d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80a9f631516b4b858659bf609e549610"
I20260811 07:31:23.183172 456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c8acea7b51c4c6aad0e995923a2c962" candidate_uuid: "0d257cebc94940279ba5e474a2e668d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0318dc8258e4654b44ca88cb3a4fd81"
I20260811 07:31:23.183298 757 raft_consensus.cc:3037] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:23.183321 456 raft_consensus.cc:3037] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:23.184444 456 raft_consensus.cc:2454] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d257cebc94940279ba5e474a2e668d6 in term 1.
I20260811 07:31:23.184459 757 raft_consensus.cc:2454] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d257cebc94940279ba5e474a2e668d6 in term 1.
I20260811 07:31:23.184887 533 leader_election.cc:302] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d257cebc94940279ba5e474a2e668d6, 80a9f631516b4b858659bf609e549610; no voters:
I20260811 07:31:23.185101 838 raft_consensus.cc:2781] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:23.185338 838 raft_consensus.cc:686] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 1 LEADER]: Becoming Leader. State: Replica: 0d257cebc94940279ba5e474a2e668d6, State: Running, Role: LEADER
I20260811 07:31:23.185707 838 consensus_queue.cc:237] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } }
I20260811 07:31:23.189450 32750 catalog_manager.cc:5495] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d257cebc94940279ba5e474a2e668d6 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "0d257cebc94940279ba5e474a2e668d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d257cebc94940279ba5e474a2e668d6" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 36885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 } health_report { overall_health: UNKNOWN } } }
W20260811 07:31:23.193187 811 tablet.cc:2369] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:31:23.197602 656 tablet.cc:2369] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:31:23.202940 509 tablet.cc:2369] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:31:23.245970 826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.242129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41592 (local address 127.11.248.2:36885)
0811 07:31:23.242308 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:23.242312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:23.242328 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:31:23.242405 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:23.242408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:23.242471 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:23.242578 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:31:23.242843 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.243370 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.244294 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.244537 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.244634 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.245095 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:31:23.245534 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:31:23.245652 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.245739 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.245776 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:31:23.253152 456 raft_consensus.cc:1261] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 1 FOLLOWER]: Refusing update from remote peer 0d257cebc94940279ba5e474a2e668d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:23.253168 757 raft_consensus.cc:1261] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 1 FOLLOWER]: Refusing update from remote peer 0d257cebc94940279ba5e474a2e668d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:23.254068 841 consensus_queue.cc:1035] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0318dc8258e4654b44ca88cb3a4fd81" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:23.254317 838 consensus_queue.cc:1035] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80a9f631516b4b858659bf609e549610" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 41091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:23.263676 847 mvcc.cc:205] Tried to move back new op lower bound from 7317231547395878912 to 7317231547131588608. Current Snapshot: MvccSnapshot[applied={T|T < 7317231547395878912}]
I20260811 07:31:23.265612 846 mvcc.cc:205] Tried to move back new op lower bound from 7317231547395878912 to 7317231547131588608. Current Snapshot: MvccSnapshot[applied={T|T < 7317231547395878912}]
I20260811 07:31:23.273542 32748 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42044:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:23.273747 32748 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42044:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:23.276503 32748 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc732515fea6496aac04810f7c81dd35: Sending DeleteTablet for 3 replicas of tablet 9c8acea7b51c4c6aad0e995923a2c962
I20260811 07:31:23.277534 731 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c8acea7b51c4c6aad0e995923a2c962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:23 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:41944
I20260811 07:31:23.277613 432 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c8acea7b51c4c6aad0e995923a2c962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:23 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:35478
I20260811 07:31:23.278184 856 tablet_replica.cc:330] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81: stopping tablet replica
I20260811 07:31:23.278178 855 tablet_replica.cc:330] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: stopping tablet replica
I20260811 07:31:23.278548 856 raft_consensus.cc:2229] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:23.278548 855 raft_consensus.cc:2229] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:23.278546 581 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c8acea7b51c4c6aad0e995923a2c962 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:23 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:41588
I20260811 07:31:23.278904 855 raft_consensus.cc:2258] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:23.278904 856 raft_consensus.cc:2258] T 9c8acea7b51c4c6aad0e995923a2c962 P b0318dc8258e4654b44ca88cb3a4fd81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:23.279570 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 359
I20260811 07:31:23.280602 855 ts_tablet_manager.cc:1905] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:23.284835 855 ts_tablet_manager.cc:1918] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:23.284974 855 log.cc:1196] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/9c8acea7b51c4c6aad0e995923a2c962
I20260811 07:31:23.285327 855 ts_tablet_manager.cc:1939] T 9c8acea7b51c4c6aad0e995923a2c962 P 80a9f631516b4b858659bf609e549610: Deleting consensus metadata
I20260811 07:31:23.285631 857 tablet_replica.cc:330] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: stopping tablet replica
I20260811 07:31:23.286320 857 raft_consensus.cc:2229] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:31:23.286798 857 raft_consensus.cc:2258] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:23.287077 32735 catalog_manager.cc:4841] TS 80a9f631516b4b858659bf609e549610 (127.11.248.3:41091): tablet 9c8acea7b51c4c6aad0e995923a2c962 (table test-table [id=e03992d91ada47c08549a55bd6b0968e]) successfully deleted
I20260811 07:31:23.288527 857 ts_tablet_manager.cc:1905] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:23.291991 857 ts_tablet_manager.cc:1918] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:23.292129 857 log.cc:1196] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/9c8acea7b51c4c6aad0e995923a2c962
I20260811 07:31:23.292465 857 ts_tablet_manager.cc:1939] T 9c8acea7b51c4c6aad0e995923a2c962 P 0d257cebc94940279ba5e474a2e668d6: Deleting consensus metadata
I20260811 07:31:23.294401 32733 catalog_manager.cc:4841] TS 0d257cebc94940279ba5e474a2e668d6 (127.11.248.2:36885): tablet 9c8acea7b51c4c6aad0e995923a2c962 (table test-table [id=e03992d91ada47c08549a55bd6b0968e]) successfully deleted
W20260811 07:31:23.296705 32734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:44995 (error 108)
I20260811 07:31:23.298866 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 513
I20260811 07:31:23.299073 827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.298720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:44995 (local address 127.0.0.1:35488)
0811 07:31:23.298883 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:23.298963 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:44995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260811 07:31:23.300940 32734 catalog_manager.cc:4584] TS b0318dc8258e4654b44ca88cb3a4fd81 (127.11.248.1:44995): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c8acea7b51c4c6aad0e995923a2c962: Network error: Client connection negotiation failed: client connection to 127.11.248.1:44995: connect: Connection refused (error 111)
I20260811 07:31:23.307546 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 660
I20260811 07:31:23.316906 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 32714
2026-08-11T07:31:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2725 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T07:31:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:23Z Disabled control of system clock
I20260811 07:31:23.354859 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43171
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:37483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:43171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:31:23.479689 863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:23.480011 863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:23.480051 863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:23.484441 863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:23.484537 863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:23.484552 863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:23.484570 863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:23.484586 863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:23.490012 863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:43171
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:43171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:23.491242 863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:23.492692 863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:23.502274 872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:23.502314 869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:23.502272 870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:23.502686 863 server_base.cc:1034] running on GCE node
I20260811 07:31:23.503314 863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:23.504482 863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:23.505713 863 hybrid_clock.cc:648] HybridClock initialized: now 1786433483505673 us; error 57 us; skew 500 ppm
I20260811 07:31:23.507928 863 webserver.cc:460] Webserver started at http://127.11.248.62:43951/ using document root <none> and password file <none>
I20260811 07:31:23.508566 863 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:23.508674 863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:23.509055 863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:23.511282 863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "055ecac8842d4f75bff1149929d95691"
format_stamp: "Formatted at 2026-08-11 07:31:23 on dist-test-slave-77v9"
server_key: "d404b04179519dd893d336b1dab6b8b4"
server_key_iv: "e7c17af586766c5ee13c7a55e9903f19"
server_key_version: "encryptionkey@0"
I20260811 07:31:23.511921 863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "055ecac8842d4f75bff1149929d95691"
format_stamp: "Formatted at 2026-08-11 07:31:23 on dist-test-slave-77v9"
server_key: "d404b04179519dd893d336b1dab6b8b4"
server_key_iv: "e7c17af586766c5ee13c7a55e9903f19"
server_key_version: "encryptionkey@0"
I20260811 07:31:23.516301 863 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:31:23.519542 879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:23.521198 863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 07:31:23.521377 863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "055ecac8842d4f75bff1149929d95691"
format_stamp: "Formatted at 2026-08-11 07:31:23 on dist-test-slave-77v9"
server_key: "d404b04179519dd893d336b1dab6b8b4"
server_key_iv: "e7c17af586766c5ee13c7a55e9903f19"
server_key_version: "encryptionkey@0"
I20260811 07:31:23.521534 863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:23.558326 863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:23.559317 863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:23.559542 863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:23.567497 863 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:43171
I20260811 07:31:23.567521 936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:43171 every 8 connection(s)
I20260811 07:31:23.568595 863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:23.572403 938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:23.573982 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 863
I20260811 07:31:23.574136 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:23.574545 12256 external_mini_cluster.cc:1428] Setting key fe2e9a6b537bb7f2b9f91c9bf09c929e
I20260811 07:31:23.580083 938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691: Bootstrap starting.
I20260811 07:31:23.583066 938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:23.584012 938 log.cc:824] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:23.585573 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.576342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.11.248.62:43171)
0811 07:31:23.577217 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:23.577235 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:23.577277 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:31:23.577979 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:23.577999 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:23.578424 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:23.578807 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:23.579344 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.580408 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.581454 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.581980 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.582171 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.583403 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:23.583409 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:23.583425 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:23.583912 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:23.583983 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:23.584006 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:23.584139 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.584355 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.584673 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":177,"threads_started":1}
I20260811 07:31:23.586549 938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691: No bootstrap required, opened a new log
I20260811 07:31:23.590968 938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "055ecac8842d4f75bff1149929d95691" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43171 } }
I20260811 07:31:23.591291 938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:23.591332 938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 055ecac8842d4f75bff1149929d95691, State: Initialized, Role: FOLLOWER
I20260811 07:31:23.591866 938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "055ecac8842d4f75bff1149929d95691" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43171 } }
I20260811 07:31:23.592073 938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:23.592157 938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:23.592296 938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:23.593621 938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "055ecac8842d4f75bff1149929d95691" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43171 } }
I20260811 07:31:23.594046 938 leader_election.cc:302] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 055ecac8842d4f75bff1149929d95691; no voters:
I20260811 07:31:23.594451 938 leader_election.cc:288] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:23.594651 943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:23.594906 943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [term 1 LEADER]: Becoming Leader. State: Replica: 055ecac8842d4f75bff1149929d95691, State: Running, Role: LEADER
I20260811 07:31:23.595256 943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "055ecac8842d4f75bff1149929d95691" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43171 } }
I20260811 07:31:23.595937 938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:23.597280 945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 055ecac8842d4f75bff1149929d95691. Latest consensus state: current_term: 1 leader_uuid: "055ecac8842d4f75bff1149929d95691" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "055ecac8842d4f75bff1149929d95691" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43171 } } }
I20260811 07:31:23.597267 944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "055ecac8842d4f75bff1149929d95691" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "055ecac8842d4f75bff1149929d95691" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 43171 } } }
I20260811 07:31:23.597434 944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:23.597434 945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:23.597995 953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:23.601542 953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:23.609268 953 catalog_manager.cc:1347] Generated new cluster ID: a2a2aa4edbd44501b26dda552799f770
I20260811 07:31:23.609381 953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:23.624611 953 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:23.626169 953 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:23.636936 953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691: Generated new TSK 0
I20260811 07:31:23.637889 953 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:23.647871 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43171
--builtin_ntp_servers=127.11.248.20:37483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:31:23.786017 964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:23.786418 964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:23.786532 964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:23.791003 964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:23.791122 964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:23.791237 964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:23.796607 964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:23.798007 964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:23.799485 964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:23.809988 970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:23.810001 971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:23.809995 973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:23.810338 964 server_base.cc:1034] running on GCE node
I20260811 07:31:23.810974 964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:23.811789 964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:23.812956 964 hybrid_clock.cc:648] HybridClock initialized: now 1786433483812925 us; error 52 us; skew 500 ppm
I20260811 07:31:23.815173 964 webserver.cc:460] Webserver started at http://127.11.248.1:34977/ using document root <none> and password file <none>
I20260811 07:31:23.815757 964 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:23.815833 964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:23.816023 964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:23.818444 964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "de6602ed7e06441ba12da87e763d96da"
format_stamp: "Formatted at 2026-08-11 07:31:23 on dist-test-slave-77v9"
server_key: "d7e81f0ab47e9944a2999a48f946981b"
server_key_iv: "1be2a9a195a6989e302c4bd05d2d7770"
server_key_version: "encryptionkey@0"
I20260811 07:31:23.819130 964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "de6602ed7e06441ba12da87e763d96da"
format_stamp: "Formatted at 2026-08-11 07:31:23 on dist-test-slave-77v9"
server_key: "d7e81f0ab47e9944a2999a48f946981b"
server_key_iv: "1be2a9a195a6989e302c4bd05d2d7770"
server_key_version: "encryptionkey@0"
I20260811 07:31:23.823508 964 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:23.826617 980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:23.828159 964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:31:23.828300 964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "de6602ed7e06441ba12da87e763d96da"
format_stamp: "Formatted at 2026-08-11 07:31:23 on dist-test-slave-77v9"
server_key: "d7e81f0ab47e9944a2999a48f946981b"
server_key_iv: "1be2a9a195a6989e302c4bd05d2d7770"
server_key_version: "encryptionkey@0"
I20260811 07:31:23.828418 964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:23.851773 964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:23.852505 964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:23.852675 964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:23.853346 964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:23.854478 964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:23.854533 964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:23.854578 964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:23.854592 964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:23.864629 964 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:43221
I20260811 07:31:23.864710 1115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:43221 every 8 connection(s)
I20260811 07:31:23.865691 964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:23.868163 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 964
I20260811 07:31:23.868304 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:31:23.868606 12256 external_mini_cluster.cc:1428] Setting key fdc235209e54b36e88b3b062d36cb231
I20260811 07:31:23.871074 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43171
--builtin_ntp_servers=127.11.248.20:37483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:31:23.877539 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.867735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:36431 (local address 127.11.248.62:43171)
0811 07:31:23.867895 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:23.867901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:23.869267 (+ 1366us) server_negotiation.cc:407] Connection header received
0811 07:31:23.871072 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:23.871075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:23.871137 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:23.871237 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:23.872301 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.873219 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.874956 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.875374 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.875510 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.876870 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:23.876878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:23.876884 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:23.876905 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:23.876937 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:23.876953 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:23.877042 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:23.877217 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:31:23.877312 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:31:23.878433 1118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:23.868209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43171 (local address 127.11.248.1:36431)
0811 07:31:23.869074 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:23.869131 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:23.870836 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:23.871503 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:23.871511 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:23.871603 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:23.872140 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.872153 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.873364 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.873369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.874793 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:23.874805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:23.875550 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:23.875553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:23.875718 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:23.876527 (+ 809us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:23.876528 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:23.876574 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:23.876649 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:23.877063 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:23.877071 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:23.877076 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:31:23.877181 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 07:31:23.877437 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":162,"threads_started":1}
I20260811 07:31:23.879911 1116 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43171
I20260811 07:31:23.880220 1116 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:23.881024 1116 heartbeater.cc:511] Master 127.11.248.62:43171 requested a full tablet report, sending...
I20260811 07:31:23.882782 899 ts_manager.cc:194] Registered new tserver with Master: de6602ed7e06441ba12da87e763d96da (127.11.248.1:43221)
I20260811 07:31:23.883980 899 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.1:36431
W20260811 07:31:23.989794 1119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:23.990100 1119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:23.990140 1119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:23.994369 1119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:23.994447 1119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:23.994504 1119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:23.999836 1119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:24.001080 1119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:24.002599 1119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:24.013031 1124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:24.013022 1125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:24.013022 1127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:24.013293 1119 server_base.cc:1034] running on GCE node
I20260811 07:31:24.013878 1119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:24.014644 1119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:24.015877 1119 hybrid_clock.cc:648] HybridClock initialized: now 1786433484015857 us; error 80 us; skew 500 ppm
I20260811 07:31:24.018074 1119 webserver.cc:460] Webserver started at http://127.11.248.2:44619/ using document root <none> and password file <none>
I20260811 07:31:24.018716 1119 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:24.018854 1119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:24.019129 1119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:24.021481 1119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "79c34f08da794578a4b374ec986bd818"
format_stamp: "Formatted at 2026-08-11 07:31:24 on dist-test-slave-77v9"
server_key: "0db7bcb13896222925bdb69e4c3543f7"
server_key_iv: "bb2e8b679c10c2e12474ffda66d0dc76"
server_key_version: "encryptionkey@0"
I20260811 07:31:24.022116 1119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "79c34f08da794578a4b374ec986bd818"
format_stamp: "Formatted at 2026-08-11 07:31:24 on dist-test-slave-77v9"
server_key: "0db7bcb13896222925bdb69e4c3543f7"
server_key_iv: "bb2e8b679c10c2e12474ffda66d0dc76"
server_key_version: "encryptionkey@0"
I20260811 07:31:24.026360 1119 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:24.029429 1135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:24.031163 1119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:24.031394 1119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "79c34f08da794578a4b374ec986bd818"
format_stamp: "Formatted at 2026-08-11 07:31:24 on dist-test-slave-77v9"
server_key: "0db7bcb13896222925bdb69e4c3543f7"
server_key_iv: "bb2e8b679c10c2e12474ffda66d0dc76"
server_key_version: "encryptionkey@0"
I20260811 07:31:24.031564 1119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:24.057701 1119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:24.058650 1119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:24.058898 1119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:24.059574 1119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:24.060635 1119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:24.060716 1119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:24.060786 1119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:24.060853 1119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260811 07:31:24.070708 1119 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:38997
I20260811 07:31:24.070745 1264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:38997 every 8 connection(s)
I20260811 07:31:24.071735 1119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:24.080634 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 1119
I20260811 07:31:24.080799 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:31:24.081235 12256 external_mini_cluster.cc:1428] Setting key 279d969b12bc08030f979cb4661f69dd
I20260811 07:31:24.082217 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.073877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:59523 (local address 127.11.248.62:43171)
0811 07:31:24.074045 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.074049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.075207 (+ 1158us) server_negotiation.cc:407] Connection header received
0811 07:31:24.076696 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.076700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.076768 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.076914 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:24.077905 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.078449 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.079680 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.079921 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.080041 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.081610 (+ 1569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:24.081613 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:24.081616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:24.081630 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:24.081681 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:24.081696 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:24.081801 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.082001 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.082076 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:31:24.083350 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.074325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43171 (local address 127.11.248.2:59523)
0811 07:31:24.075038 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.075083 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.076447 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.077097 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.077104 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.077195 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:24.077731 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.077744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.078592 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.078595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.079528 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.079538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.080117 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.080124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.080362 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.081236 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:24.081238 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:24.081302 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:24.081410 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:24.081812 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:24.081827 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:24.081832 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.081973 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.082378 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":158,"threads_started":1}
I20260811 07:31:24.083720 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43171
--builtin_ntp_servers=127.11.248.20:37483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:31:24.084910 1265 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43171
I20260811 07:31:24.085201 1265 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:24.086055 1265 heartbeater.cc:511] Master 127.11.248.62:43171 requested a full tablet report, sending...
I20260811 07:31:24.087494 899 ts_manager.cc:194] Registered new tserver with Master: 79c34f08da794578a4b374ec986bd818 (127.11.248.2:38997)
I20260811 07:31:24.088104 899 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.2:59523
W20260811 07:31:24.206869 1268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:24.207167 1268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:24.207207 1268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:24.211928 1268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:24.212008 1268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:24.212069 1268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:24.217285 1268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:43171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:24.218482 1268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:24.219996 1268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:24.230906 1277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:24.230911 1274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:24.230994 1275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:24.231377 1268 server_base.cc:1034] running on GCE node
I20260811 07:31:24.231947 1268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:24.232776 1268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:24.234046 1268 hybrid_clock.cc:648] HybridClock initialized: now 1786433484234000 us; error 59 us; skew 500 ppm
I20260811 07:31:24.236275 1268 webserver.cc:460] Webserver started at http://127.11.248.3:38797/ using document root <none> and password file <none>
I20260811 07:31:24.237013 1268 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:24.237116 1268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:24.237386 1268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:24.239711 1268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "07886e6c15df4c44a6cbeaf35003cc44"
format_stamp: "Formatted at 2026-08-11 07:31:24 on dist-test-slave-77v9"
server_key: "122c5ed809cb7eead65224a16d99046d"
server_key_iv: "b237fa96a9acfeab67a7bef3c9d1525e"
server_key_version: "encryptionkey@0"
I20260811 07:31:24.240317 1268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "07886e6c15df4c44a6cbeaf35003cc44"
format_stamp: "Formatted at 2026-08-11 07:31:24 on dist-test-slave-77v9"
server_key: "122c5ed809cb7eead65224a16d99046d"
server_key_iv: "b237fa96a9acfeab67a7bef3c9d1525e"
server_key_version: "encryptionkey@0"
I20260811 07:31:24.244410 1268 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 07:31:24.247326 1285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:24.248751 1268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:31:24.249049 1268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "07886e6c15df4c44a6cbeaf35003cc44"
format_stamp: "Formatted at 2026-08-11 07:31:24 on dist-test-slave-77v9"
server_key: "122c5ed809cb7eead65224a16d99046d"
server_key_iv: "b237fa96a9acfeab67a7bef3c9d1525e"
server_key_version: "encryptionkey@0"
I20260811 07:31:24.249188 1268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:24.266575 1268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:24.267374 1268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:24.267604 1268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:24.268245 1268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:24.269375 1268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:24.269451 1268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:24.269522 1268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:24.269572 1268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:24.279443 1268 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:43135
I20260811 07:31:24.279475 1419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:43135 every 8 connection(s)
I20260811 07:31:24.280500 1268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:24.283347 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 1268
I20260811 07:31:24.283457 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:31:24.283753 12256 external_mini_cluster.cc:1428] Setting key 380674f223e154c0fc780e8b47b32e47
I20260811 07:31:24.291172 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.282803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:35817 (local address 127.11.248.62:43171)
0811 07:31:24.283097 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.283104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.284334 (+ 1230us) server_negotiation.cc:407] Connection header received
0811 07:31:24.286015 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.286019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.286078 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.286163 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:24.287137 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.287683 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.288957 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.289187 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.289317 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.290630 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:24.290638 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:24.290642 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:24.290657 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:24.290678 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:24.290687 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:24.290860 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.290946 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.291016 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 07:31:24.292120 1423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.283303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:43171 (local address 127.11.248.3:35817)
0811 07:31:24.284149 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.284210 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.285754 (+ 1544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.286351 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.286358 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.286449 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:24.286982 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.286996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.287837 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.287846 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.288742 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.288752 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.289401 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.289410 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.289579 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.290344 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:24.290346 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:24.290390 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:24.290461 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:24.290771 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:24.290782 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:24.290788 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.290933 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.291239 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":184,"threads_started":1}
I20260811 07:31:24.293563 1420 heartbeater.cc:347] Connected to a master server at 127.11.248.62:43171
I20260811 07:31:24.293815 1420 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:24.294392 1420 heartbeater.cc:511] Master 127.11.248.62:43171 requested a full tablet report, sending...
I20260811 07:31:24.295519 899 ts_manager.cc:194] Registered new tserver with Master: 07886e6c15df4c44a6cbeaf35003cc44 (127.11.248.3:43135)
I20260811 07:31:24.296185 899 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.3:35817
I20260811 07:31:24.298250 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:31:24.305410 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.300575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57172 (local address 127.11.248.62:43171)
0811 07:31:24.300781 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.300786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.301019 (+ 233us) server_negotiation.cc:407] Connection header received
0811 07:31:24.301176 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.301180 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.301238 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.301338 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:24.301672 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.302252 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.303256 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.303530 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.303655 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.304726 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:24.304730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:24.304734 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:24.304749 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:24.304780 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:24.304790 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:24.305028 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.305173 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.305223 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 07:31:24.309433 899 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:31:24.312698 899 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:31:24.330035 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.323393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43268 (local address 127.11.248.2:38997)
0811 07:31:24.323852 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.323865 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.324138 (+ 273us) server_negotiation.cc:407] Connection header received
0811 07:31:24.324391 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.324397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.324639 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.324791 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:24.325310 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.326579 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.328301 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.329171 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.329293 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.329533 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.329724 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.329841 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":111,"threads_started":1}
I20260811 07:31:24.330124 1438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.323882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:43135 (local address 127.0.0.1:47682)
0811 07:31:24.324757 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.324770 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.324893 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.325599 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.325602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.325621 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:24.325707 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.325714 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.327196 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.327200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.328453 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.328465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.329459 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.329463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.329549 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.329569 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.329651 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.329904 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":52,"thread_start_us":102,"threads_started":1}
I20260811 07:31:24.330433 1440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.324265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.11.248.3:43135)
0811 07:31:24.325147 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.325159 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.325181 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:31:24.325261 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.325267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.325438 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.325619 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:24.326021 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.327046 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.328601 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.329283 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.329840 (+ 557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.330057 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.330116 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.330225 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":211,"threads_started":1}
I20260811 07:31:24.330498 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.323131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:43221 (local address 127.0.0.1:48400)
0811 07:31:24.323632 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.323700 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.323845 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.324918 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.324924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.324949 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:24.325118 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.325125 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.326716 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.326720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.328382 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.328394 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.329461 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.329465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.329607 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.329626 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.329716 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.330018 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":262,"thread_start_us":79,"threads_started":1}
I20260811 07:31:24.330703 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.323167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:38997 (local address 127.0.0.1:43268)
0811 07:31:24.324029 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.324047 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.324217 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.325043 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.325047 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.325065 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:24.325168 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.325176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.326749 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.326751 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.328170 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.328180 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.329316 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.329321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.329497 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.329551 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.329676 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.329906 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"mutex_wait_us":115,"thread_start_us":135,"threads_started":1}
I20260811 07:31:24.331677 1439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.323967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48400 (local address 127.11.248.1:43221)
0811 07:31:24.324373 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.324387 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.324412 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:31:24.324496 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.324501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.324689 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.325273 (+ 584us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:24.325414 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.326590 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.328525 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.329314 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.331035 (+ 1721us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.331376 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.331431 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.331524 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":94,"threads_started":1}
I20260811 07:31:24.334050 1034 tablet_service.cc:1467] Processing CreateTablet for tablet 99c06ef62b5f4ff2beb444eb5cf0827e (DEFAULT_TABLE table=test-table [id=06ad117845624810988715d338a26433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:24.333911 1346 tablet_service.cc:1467] Processing CreateTablet for tablet 99c06ef62b5f4ff2beb444eb5cf0827e (DEFAULT_TABLE table=test-table [id=06ad117845624810988715d338a26433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:24.333911 1189 tablet_service.cc:1467] Processing CreateTablet for tablet 99c06ef62b5f4ff2beb444eb5cf0827e (DEFAULT_TABLE table=test-table [id=06ad117845624810988715d338a26433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:24.335135 1346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c06ef62b5f4ff2beb444eb5cf0827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:24.335135 1189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c06ef62b5f4ff2beb444eb5cf0827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:24.335139 1034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99c06ef62b5f4ff2beb444eb5cf0827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:24.342090 1441 tablet_bootstrap.cc:492] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: Bootstrap starting.
I20260811 07:31:24.343878 1443 tablet_bootstrap.cc:492] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Bootstrap starting.
I20260811 07:31:24.344515 1441 tablet_bootstrap.cc:654] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:24.345202 1442 tablet_bootstrap.cc:492] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Bootstrap starting.
I20260811 07:31:24.345395 1441 log.cc:824] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:24.346304 1443 tablet_bootstrap.cc:654] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:24.347311 1443 log.cc:824] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:24.347601 1442 tablet_bootstrap.cc:654] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:24.348045 1441 tablet_bootstrap.cc:492] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: No bootstrap required, opened a new log
I20260811 07:31:24.348272 1441 ts_tablet_manager.cc:1397] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260811 07:31:24.348506 1442 log.cc:824] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:24.349642 1443 tablet_bootstrap.cc:492] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: No bootstrap required, opened a new log
I20260811 07:31:24.349845 1443 ts_tablet_manager.cc:1397] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:31:24.350615 1442 tablet_bootstrap.cc:492] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: No bootstrap required, opened a new log
I20260811 07:31:24.350848 1442 ts_tablet_manager.cc:1397] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:31:24.353044 1441 raft_consensus.cc:348] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.353374 1441 raft_consensus.cc:374] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:24.353456 1441 raft_consensus.cc:729] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de6602ed7e06441ba12da87e763d96da, State: Initialized, Role: FOLLOWER
I20260811 07:31:24.353982 1441 consensus_queue.cc:260] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.354748 1116 heartbeater.cc:503] Master 127.11.248.62:43171 was elected leader, sending a full tablet report...
I20260811 07:31:24.354787 1442 raft_consensus.cc:348] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.355090 1442 raft_consensus.cc:374] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:24.355126 1441 ts_tablet_manager.cc:1428] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 07:31:24.355157 1442 raft_consensus.cc:729] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07886e6c15df4c44a6cbeaf35003cc44, State: Initialized, Role: FOLLOWER
I20260811 07:31:24.355690 1442 consensus_queue.cc:260] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.355710 1443 raft_consensus.cc:348] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.356024 1443 raft_consensus.cc:374] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:24.356110 1443 raft_consensus.cc:729] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c34f08da794578a4b374ec986bd818, State: Initialized, Role: FOLLOWER
I20260811 07:31:24.356518 1420 heartbeater.cc:503] Master 127.11.248.62:43171 was elected leader, sending a full tablet report...
I20260811 07:31:24.356591 1443 consensus_queue.cc:260] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.356808 1442 ts_tablet_manager.cc:1428] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 07:31:24.357278 1265 heartbeater.cc:503] Master 127.11.248.62:43171 was elected leader, sending a full tablet report...
I20260811 07:31:24.357822 1443 ts_tablet_manager.cc:1428] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
W20260811 07:31:24.367018 1117 tablet.cc:2369] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:31:24.398916 1451 raft_consensus.cc:482] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:24.399300 1451 raft_consensus.cc:504] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.400619 1451 leader_election.cc:288] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de6602ed7e06441ba12da87e763d96da (127.11.248.1:43221), 07886e6c15df4c44a6cbeaf35003cc44 (127.11.248.3:43135)
I20260811 07:31:24.405164 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.401036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:43221 (local address 127.11.248.2:57233)
0811 07:31:24.401183 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.401201 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.401312 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.401840 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.401843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.401863 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:24.401975 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.401981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.403000 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.403006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.403946 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.403956 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.404657 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.404661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.404776 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.404803 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.404932 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.405016 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":22}
I20260811 07:31:24.405164 1439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.401151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:57233 (local address 127.11.248.1:43221)
0811 07:31:24.401332 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.401337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.401362 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:31:24.401431 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.401434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.401490 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.401593 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:24.402124 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.402872 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.404106 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.404522 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.404669 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.404726 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.404950 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.405033 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:31:24.405632 1452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.401356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:43135 (local address 127.11.248.2:35997)
0811 07:31:24.401827 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.401854 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:24.402016 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:24.402369 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:24.402373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:24.402392 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:24.402516 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.402523 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.403466 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.403471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.404356 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:24.404366 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.405130 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.405134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:24.405244 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.405269 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:31:24.405413 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 07:31:24.405496 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":21,"thread_start_us":192,"threads_started":1}
I20260811 07:31:24.405697 1440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.401487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:35997 (local address 127.11.248.3:43135)
0811 07:31:24.401651 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.401656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.401934 (+ 278us) server_negotiation.cc:407] Connection header received
0811 07:31:24.402168 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.402171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.402225 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.402308 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:24.402642 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.403339 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.404509 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.404986 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.405127 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.405173 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.405460 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.405548 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:31:24.406235 1058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c06ef62b5f4ff2beb444eb5cf0827e" candidate_uuid: "79c34f08da794578a4b374ec986bd818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de6602ed7e06441ba12da87e763d96da" is_pre_election: true
I20260811 07:31:24.406661 1058 raft_consensus.cc:2454] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c34f08da794578a4b374ec986bd818 in term 0.
I20260811 07:31:24.406690 1368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c06ef62b5f4ff2beb444eb5cf0827e" candidate_uuid: "79c34f08da794578a4b374ec986bd818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07886e6c15df4c44a6cbeaf35003cc44" is_pre_election: true
I20260811 07:31:24.407123 1368 raft_consensus.cc:2454] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79c34f08da794578a4b374ec986bd818 in term 0.
I20260811 07:31:24.407271 1136 leader_election.cc:302] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c34f08da794578a4b374ec986bd818, de6602ed7e06441ba12da87e763d96da; no voters:
I20260811 07:31:24.407617 1451 raft_consensus.cc:2781] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:31:24.407707 1451 raft_consensus.cc:482] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:31:24.407740 1451 raft_consensus.cc:3037] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:24.409011 1451 raft_consensus.cc:504] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.409394 1451 leader_election.cc:288] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [CANDIDATE]: Term 1 election: Requested vote from peers de6602ed7e06441ba12da87e763d96da (127.11.248.1:43221), 07886e6c15df4c44a6cbeaf35003cc44 (127.11.248.3:43135)
I20260811 07:31:24.409803 1058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c06ef62b5f4ff2beb444eb5cf0827e" candidate_uuid: "79c34f08da794578a4b374ec986bd818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de6602ed7e06441ba12da87e763d96da"
I20260811 07:31:24.409929 1368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99c06ef62b5f4ff2beb444eb5cf0827e" candidate_uuid: "79c34f08da794578a4b374ec986bd818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07886e6c15df4c44a6cbeaf35003cc44"
I20260811 07:31:24.409968 1058 raft_consensus.cc:3037] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:24.410130 1368 raft_consensus.cc:3037] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:24.411161 1058 raft_consensus.cc:2454] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c34f08da794578a4b374ec986bd818 in term 1.
I20260811 07:31:24.411468 1368 raft_consensus.cc:2454] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79c34f08da794578a4b374ec986bd818 in term 1.
I20260811 07:31:24.411649 1136 leader_election.cc:302] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79c34f08da794578a4b374ec986bd818, de6602ed7e06441ba12da87e763d96da; no voters:
I20260811 07:31:24.411901 1451 raft_consensus.cc:2781] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:24.412215 1451 raft_consensus.cc:686] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 1 LEADER]: Becoming Leader. State: Replica: 79c34f08da794578a4b374ec986bd818, State: Running, Role: LEADER
I20260811 07:31:24.412600 1451 consensus_queue.cc:237] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } }
I20260811 07:31:24.416399 897 catalog_manager.cc:5495] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79c34f08da794578a4b374ec986bd818 (127.11.248.2). New cstate: current_term: 1 leader_uuid: "79c34f08da794578a4b374ec986bd818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79c34f08da794578a4b374ec986bd818" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 38997 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 } health_report { overall_health: UNKNOWN } } }
I20260811 07:31:24.432634 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.428782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43270 (local address 127.11.248.2:38997)
0811 07:31:24.428981 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:24.428985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:24.429000 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:31:24.429071 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:24.429073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:24.429135 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:24.429234 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:31:24.429514 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.430056 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.430968 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:24.431190 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:24.431279 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:24.431570 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:31:24.432112 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:31:24.432231 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:24.432449 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 07:31:24.432489 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260811 07:31:24.440007 1058 raft_consensus.cc:1261] T 99c06ef62b5f4ff2beb444eb5cf0827e P de6602ed7e06441ba12da87e763d96da [term 1 FOLLOWER]: Refusing update from remote peer 79c34f08da794578a4b374ec986bd818: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:24.439982 1368 raft_consensus.cc:1261] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 1 FOLLOWER]: Refusing update from remote peer 79c34f08da794578a4b374ec986bd818: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:24.440949 1453 consensus_queue.cc:1035] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de6602ed7e06441ba12da87e763d96da" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 43221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:24.441160 1451 consensus_queue.cc:1035] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07886e6c15df4c44a6cbeaf35003cc44" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 43135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:24.450910 1459 mvcc.cc:205] Tried to move back new op lower bound from 7317231552257069056 to 7317231552157085696. Current Snapshot: MvccSnapshot[applied={T|T < 7317231552257069056}]
I20260811 07:31:24.454054 1457 mvcc.cc:205] Tried to move back new op lower bound from 7317231552257069056 to 7317231552157085696. Current Snapshot: MvccSnapshot[applied={T|T < 7317231552257069056 or (T in {7317231552257069056})}]
I20260811 07:31:24.461036 897 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:24.461239 897 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:24.464327 897 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 055ecac8842d4f75bff1149929d95691: Sending DeleteTablet for 3 replicas of tablet 99c06ef62b5f4ff2beb444eb5cf0827e
I20260811 07:31:24.465536 1034 tablet_service.cc:1514] Processing DeleteTablet for tablet 99c06ef62b5f4ff2beb444eb5cf0827e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:24 UTC) from {username='slave'} at 127.0.0.1:48400
I20260811 07:31:24.465773 1346 tablet_service.cc:1514] Processing DeleteTablet for tablet 99c06ef62b5f4ff2beb444eb5cf0827e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:24 UTC) from {username='slave'} at 127.0.0.1:47682
I20260811 07:31:24.466169 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 964
I20260811 07:31:24.466187 1189 tablet_service.cc:1514] Processing DeleteTablet for tablet 99c06ef62b5f4ff2beb444eb5cf0827e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:24 UTC) from {username='slave'} at 127.0.0.1:43268
I20260811 07:31:24.467839 1471 tablet_replica.cc:330] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: stopping tablet replica
I20260811 07:31:24.468266 1471 raft_consensus.cc:2229] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:24.468650 1471 raft_consensus.cc:2258] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:24.469575 1472 tablet_replica.cc:330] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: stopping tablet replica
I20260811 07:31:24.469925 1472 raft_consensus.cc:2229] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:31:24.470321 1472 raft_consensus.cc:2258] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:24.471230 1471 ts_tablet_manager.cc:1905] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:24.471803 1472 ts_tablet_manager.cc:1905] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:24.474828 1471 ts_tablet_manager.cc:1918] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:24.474980 1471 log.cc:1196] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/99c06ef62b5f4ff2beb444eb5cf0827e
I20260811 07:31:24.475272 1472 ts_tablet_manager.cc:1918] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 07:31:24.475265 880 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:43221 (error 108)
I20260811 07:31:24.475378 1471 ts_tablet_manager.cc:1939] T 99c06ef62b5f4ff2beb444eb5cf0827e P 07886e6c15df4c44a6cbeaf35003cc44: Deleting consensus metadata
I20260811 07:31:24.475396 1472 log.cc:1196] T 99c06ef62b5f4ff2beb444eb5cf0827e P 79c34f08da794578a4b374ec986bd818: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/99c06ef62b5f4ff2beb444eb5cf0827e
I20260811 07:31:24.475561 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 1119
I20260811 07:31:24.477783 880 catalog_manager.cc:4841] TS 07886e6c15df4c44a6cbeaf35003cc44 (127.11.248.3:43135): tablet 99c06ef62b5f4ff2beb444eb5cf0827e (table test-table [id=06ad117845624810988715d338a26433]) successfully deleted
I20260811 07:31:24.479465 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.478989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:43221 (local address 127.0.0.1:48416)
0811 07:31:24.479237 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.479340 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:43221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260811 07:31:24.479713 880 catalog_manager.cc:4584] TS de6602ed7e06441ba12da87e763d96da (127.11.248.1:43221): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 99c06ef62b5f4ff2beb444eb5cf0827e: Network error: Client connection negotiation failed: client connection to 127.11.248.1:43221: connect: Connection refused (error 111)
I20260811 07:31:24.484537 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 1268
I20260811 07:31:24.489456 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:24.484854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:38997 (local address 127.0.0.1:43284)
0811 07:31:24.489212 (+ 4358us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:24.489322 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.2:38997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4198}
I20260811 07:31:24.494160 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 863
2026-08-11T07:31:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1175 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:24 dist-test-slave-77v9 krb5kdc[1477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:24 dist-test-slave-77v9 krb5kdc[1477](info): set up 2 sockets
Aug 11 07:31:24 dist-test-slave-77v9 krb5kdc[1477](info): commencing operation
krb5kdc: starting...
W20260811 07:31:25.694993 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:25 dist-test-slave-77v9 krb5kdc[1477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:25.853749 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44191
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:44191
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:25.988155 1491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:25.988595 1491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:25.988690 1491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:25.993158 1491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:25.993301 1491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:25.993345 1491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:25.993393 1491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:25.993451 1491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:25.999852 1491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:44191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:26.001250 1491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:26.002434 1491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:26.012642 1496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.012663 1502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.012642 1498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:26.013321 1491 server_base.cc:1034] running on GCE node
I20260811 07:31:26.014257 1491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:26.015636 1491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:26.016963 1491 hybrid_clock.cc:648] HybridClock initialized: now 1786433486016942 us; error 41 us; skew 500 ppm
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:26.020427 1491 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:26.021641 1491 webserver.cc:460] Webserver started at http://127.11.248.62:33237/ using document root <none> and password file <none>
I20260811 07:31:26.022245 1491 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:26.022312 1491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:26.022529 1491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:26.024906 1491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "94654816435a4a45935a078416d749e9"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "017d36e53bb692d48062890428791276"
server_key_iv: "9106b2aa71ff571b98b014d47066deb8"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.025517 1491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "94654816435a4a45935a078416d749e9"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "017d36e53bb692d48062890428791276"
server_key_iv: "9106b2aa71ff571b98b014d47066deb8"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.029932 1491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:26.032950 1509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.034598 1491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:26.034754 1491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "94654816435a4a45935a078416d749e9"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "017d36e53bb692d48062890428791276"
server_key_iv: "9106b2aa71ff571b98b014d47066deb8"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.034894 1491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:26.050561 1491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:26.054682 1491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:26.054975 1491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:26.064128 1491 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:44191
I20260811 07:31:26.064154 1570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:44191 every 8 connection(s)
I20260811 07:31:26.065338 1491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:26.068785 1572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:26.073760 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 1491
I20260811 07:31:26.074035 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:26.074374 12256 external_mini_cluster.cc:1428] Setting key 2b571ccf119cb8feaa48a32e0253385c
I20260811 07:31:26.077054 1572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9: Bootstrap starting.
I20260811 07:31:26.079949 1572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:26.080906 1572 log.cc:824] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:26.083855 1572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9: No bootstrap required, opened a new log
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:26.089174 1572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94654816435a4a45935a078416d749e9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44191 } }
I20260811 07:31:26.089455 1572 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:26.089493 1572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94654816435a4a45935a078416d749e9, State: Initialized, Role: FOLLOWER
I20260811 07:31:26.090013 1572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94654816435a4a45935a078416d749e9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44191 } }
I20260811 07:31:26.090183 1572 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:26.090284 1572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:26.090420 1572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:26.091457 1572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94654816435a4a45935a078416d749e9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44191 } }
I20260811 07:31:26.091845 1572 leader_election.cc:302] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94654816435a4a45935a078416d749e9; no voters:
I20260811 07:31:26.092226 1572 leader_election.cc:288] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:26.092365 1577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:26.092656 1577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [term 1 LEADER]: Becoming Leader. State: Replica: 94654816435a4a45935a078416d749e9, State: Running, Role: LEADER
I20260811 07:31:26.093065 1577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94654816435a4a45935a078416d749e9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44191 } }
I20260811 07:31:26.093755 1572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:26.094206 1575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.076235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55206 (local address 127.11.248.62:44191)
0811 07:31:26.076759 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.076785 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.076875 (+ 90us) server_negotiation.cc:407] Connection header received
0811 07:31:26.077654 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.077674 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.078062 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.078381 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:26.079441 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.080672 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.081859 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.082607 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.083284 (+ 677us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.087669 (+ 4385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:26.087676 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:26.087701 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:26.087739 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:26.089997 (+ 2258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.090818 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.090826 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.090833 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.090987 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.091368 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.091371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.091372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.091898 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:26.092133 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:26.092616 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 07:31:26.093073 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":198,"threads_started":1}
I20260811 07:31:26.094956 1578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94654816435a4a45935a078416d749e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94654816435a4a45935a078416d749e9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44191 } } }
I20260811 07:31:26.095005 1579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94654816435a4a45935a078416d749e9. Latest consensus state: current_term: 1 leader_uuid: "94654816435a4a45935a078416d749e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94654816435a4a45935a078416d749e9" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44191 } } }
I20260811 07:31:26.095103 1578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:26.095106 1579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:26.097177 1581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:26.099989 1581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:26.105844 1581 catalog_manager.cc:1347] Generated new cluster ID: fbf98037e55d422e97126879de8d68e3
I20260811 07:31:26.105947 1581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:26.111408 1581 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:26.112450 1581 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:26.123752 1581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9: Generated new TSK 0
I20260811 07:31:26.124635 1581 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.248.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
Entry for principal kudu/127.11.248.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab.
I20260811 07:31:26.172056 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44191
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:26.313675 1602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:26.314006 1602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:26.314057 1602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:26.318900 1602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:26.319003 1602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:26.319068 1602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:26.325528 1602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.1.keytab
--principal=kudu/127.11.248.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:26.326829 1602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:26.327963 1602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:26.339023 1608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.339022 1610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:26.339332 1602 server_base.cc:1034] running on GCE node
W20260811 07:31:26.339018 1607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:26.339993 1602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:26.340755 1602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:26.342005 1602 hybrid_clock.cc:648] HybridClock initialized: now 1786433486341977 us; error 45 us; skew 500 ppm
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:26.345278 1602 init.cc:377] Logged in from keytab as kudu/127.11.248.1@KRBTEST.COM (short username kudu)
I20260811 07:31:26.346403 1602 webserver.cc:460] Webserver started at http://127.11.248.1:37811/ using document root <none> and password file <none>
I20260811 07:31:26.347045 1602 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:26.347118 1602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:26.347308 1602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:26.349848 1602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "732a41cbb415f856f1feca9b1bfc0311"
server_key_iv: "4d826647ea29bfd1e33f0c0e03bc8cb9"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.350482 1602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "732a41cbb415f856f1feca9b1bfc0311"
server_key_iv: "4d826647ea29bfd1e33f0c0e03bc8cb9"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.354976 1602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:26.357947 1619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.359580 1602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:31:26.359771 1602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "732a41cbb415f856f1feca9b1bfc0311"
server_key_iv: "4d826647ea29bfd1e33f0c0e03bc8cb9"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.359922 1602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:26.388325 1602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:26.392334 1602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:26.392570 1602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:26.393327 1602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:26.394284 1602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:26.394371 1602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.394443 1602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:26.394495 1602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.405134 1602 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:45079
I20260811 07:31:26.405210 1742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:45079 every 8 connection(s)
I20260811 07:31:26.406231 1602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:26.412690 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 1602
I20260811 07:31:26.413111 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:31:26.413499 12256 external_mini_cluster.cc:1428] Setting key 59006be19e3fd27cdbd4e0b131d6293b
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.1@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:26.423316 1575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.408587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:55641 (local address 127.11.248.62:44191)
0811 07:31:26.408734 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.408738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.409800 (+ 1062us) server_negotiation.cc:407] Connection header received
0811 07:31:26.411341 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.411344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.411395 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.411482 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:26.413040 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.413861 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.415365 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.415706 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.415848 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.419055 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:26.419059 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:26.419061 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:26.419089 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:26.420791 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.421493 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.421497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.421499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.421593 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.422008 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.422011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.422013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.422227 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:26.422346 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:26.422958 (+ 612us) server_negotiation.cc:299] Negotiation successful
0811 07:31:26.423117 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.11.248.2@KRBTEST.COM; defaulting to no policy
I20260811 07:31:26.424281 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.409085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44191 (local address 127.11.248.1:55641)
0811 07:31:26.409615 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:26.409666 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:26.411095 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:26.411715 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:26.411723 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:26.412203 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:26.412774 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.412789 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.414044 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.414048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.415201 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.415214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.416016 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.416020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.416206 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.417024 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:26.417043 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:26.418836 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:26.420997 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:26.421005 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:26.421025 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:26.421359 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:26.421701 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:26.421706 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:26.421708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:26.421886 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:26.422373 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:26.422380 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:26.422675 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 07:31:26.422891 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 07:31:26.423279 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":131,"threads_started":1}
I20260811 07:31:26.425818 1743 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44191
I20260811 07:31:26.426132 1743 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:26.426868 1743 heartbeater.cc:511] Master 127.11.248.62:44191 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.2@KRBTEST.COM" created.
I20260811 07:31:26.428696 1525 ts_manager.cc:194] Registered new tserver with Master: ddea6f99f0dc4345a43e0f7a2743dd1d (127.11.248.1:45079)
I20260811 07:31:26.430014 1525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.1@KRBTEST.COM'} at 127.11.248.1:55641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
Entry for principal kudu/127.11.248.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab.
I20260811 07:31:26.450392 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44191
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:26.571164 1749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:26.571482 1749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:26.571528 1749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:26.575834 1749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:26.575935 1749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:26.575999 1749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:26.581785 1749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.2.keytab
--principal=kudu/127.11.248.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:26.583062 1749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:26.584226 1749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:31:26.595358 1749 server_base.cc:1034] running on GCE node
W20260811 07:31:26.595336 1754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.595711 1755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.595299 1757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:26.596279 1749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:26.597196 1749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:26.598431 1749 hybrid_clock.cc:648] HybridClock initialized: now 1786433486598397 us; error 55 us; skew 500 ppm
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:26.602146 1749 init.cc:377] Logged in from keytab as kudu/127.11.248.2@KRBTEST.COM (short username kudu)
I20260811 07:31:26.603253 1749 webserver.cc:460] Webserver started at http://127.11.248.2:41169/ using document root <none> and password file <none>
I20260811 07:31:26.603890 1749 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:26.603961 1749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:26.604215 1749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:26.606719 1749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "237c2dc920b84086bcd1ab4c66810c1f"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "717abec5b58e884ef38f33d965a9cef3"
server_key_iv: "c1a2b4a5bef6a579da2ac38afbb60e92"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.607437 1749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "237c2dc920b84086bcd1ab4c66810c1f"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "717abec5b58e884ef38f33d965a9cef3"
server_key_iv: "c1a2b4a5bef6a579da2ac38afbb60e92"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.612102 1749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 07:31:26.615008 1764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.616750 1749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:31:26.617024 1749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "237c2dc920b84086bcd1ab4c66810c1f"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "717abec5b58e884ef38f33d965a9cef3"
server_key_iv: "c1a2b4a5bef6a579da2ac38afbb60e92"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.617183 1749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:26.678061 1749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:26.681732 1749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:26.681931 1749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:26.682641 1749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:26.683557 1749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:26.683607 1749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.683684 1749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:26.683723 1749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.693625 1749 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:41275
I20260811 07:31:26.693657 1892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:41275 every 8 connection(s)
I20260811 07:31:26.694701 1749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:26.700671 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 1749
I20260811 07:31:26.700888 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:31:26.701277 12256 external_mini_cluster.cc:1428] Setting key 5b5094ef9fa4a264d9a519f34f83e4d9
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.2@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:26.712730 1575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.697080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:37923 (local address 127.11.248.62:44191)
0811 07:31:26.697245 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.697249 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.698262 (+ 1013us) server_negotiation.cc:407] Connection header received
0811 07:31:26.699657 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.699660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.699714 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.699809 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:26.701231 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.702072 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.703731 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.704121 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.704272 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.707766 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:26.707773 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:26.707779 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:26.707820 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:26.709980 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.710684 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.710691 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.710696 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.710818 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.711305 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.711309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.711311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.711593 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:26.711713 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:26.712345 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 07:31:26.712502 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
WARNING: no policy specified for kudu/127.11.248.3@KRBTEST.COM; defaulting to no policy
I20260811 07:31:26.713697 1895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.697509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44191 (local address 127.11.248.2:37923)
0811 07:31:26.698077 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:26.698126 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:26.699417 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:26.699995 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:26.700002 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:26.700427 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:26.701048 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.701073 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.702241 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.702244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.703576 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.703587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.704359 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.704363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.704545 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.705383 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:26.705402 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:26.707506 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:26.710178 (+ 2672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:26.710184 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:26.710205 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:26.710538 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:26.710970 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:26.710972 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:26.710974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:26.711164 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:26.711744 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:26.711750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:26.712045 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 07:31:26.712221 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 07:31:26.712525 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":148,"threads_started":1}
I20260811 07:31:26.715183 1893 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44191
I20260811 07:31:26.715464 1893 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:26.716022 1893 heartbeater.cc:511] Master 127.11.248.62:44191 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.3@KRBTEST.COM" created.
I20260811 07:31:26.717494 1525 ts_manager.cc:194] Registered new tserver with Master: 237c2dc920b84086bcd1ab4c66810c1f (127.11.248.2:41275)
I20260811 07:31:26.718139 1525 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.2@KRBTEST.COM'} at 127.11.248.2:37923
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
Entry for principal kudu/127.11.248.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab.
I20260811 07:31:26.737525 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44191
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:26.859248 1899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:26.859586 1899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:26.859632 1899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:26.864169 1899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:26.864285 1899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:26.864355 1899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:26.870361 1899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.3.keytab
--principal=kudu/127.11.248.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:44191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:26.871521 1899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:26.872579 1899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:26.882869 1904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.882931 1905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:26.882862 1907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:26.883150 1899 server_base.cc:1034] running on GCE node
I20260811 07:31:26.883661 1899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:26.884287 1899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:26.885545 1899 hybrid_clock.cc:648] HybridClock initialized: now 1786433486885511 us; error 48 us; skew 500 ppm
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:26.889145 1899 init.cc:377] Logged in from keytab as kudu/127.11.248.3@KRBTEST.COM (short username kudu)
I20260811 07:31:26.890204 1899 webserver.cc:460] Webserver started at http://127.11.248.3:33659/ using document root <none> and password file <none>
I20260811 07:31:26.890877 1899 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:26.890988 1899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:26.891259 1899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:26.893749 1899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "3db75537b3c1425e91934c5fad8cc422"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "f490779bfe3338de09fc974b6460c3d8"
server_key_iv: "e66b128cf0d70e6ff7a6067f73a80f88"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.894447 1899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "3db75537b3c1425e91934c5fad8cc422"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "f490779bfe3338de09fc974b6460c3d8"
server_key_iv: "e66b128cf0d70e6ff7a6067f73a80f88"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.899437 1899 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:31:26.902122 1914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.903409 1899 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 07:31:26.903576 1899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "3db75537b3c1425e91934c5fad8cc422"
format_stamp: "Formatted at 2026-08-11 07:31:26 on dist-test-slave-77v9"
server_key: "f490779bfe3338de09fc974b6460c3d8"
server_key_iv: "e66b128cf0d70e6ff7a6067f73a80f88"
server_key_version: "encryptionkey@0"
I20260811 07:31:26.903708 1899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:26.914709 1899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:26.918496 1899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:26.918735 1899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:26.919456 1899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:26.920358 1899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:26.920434 1899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.920507 1899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:26.920552 1899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:26.930433 1899 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39195
I20260811 07:31:26.930459 2042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39195 every 8 connection(s)
I20260811 07:31:26.931411 1899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:26.936993 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 1899
I20260811 07:31:26.937157 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:31:26.937551 12256 external_mini_cluster.cc:1428] Setting key deba5db1d41912f423d6bd614e4ae9f2
Aug 11 07:31:26 dist-test-slave-77v9 krb5kdc[1477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433486, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.3@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:26.947311 1575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.933407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:42095 (local address 127.11.248.62:44191)
0811 07:31:26.933561 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.933564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.934476 (+ 912us) server_negotiation.cc:407] Connection header received
0811 07:31:26.936031 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.936035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.936099 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.936186 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:26.937955 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.938956 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.940473 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.940702 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.940962 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.943707 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:26.943710 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:26.943712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:26.943740 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:26.945303 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.945797 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.945800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.945801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.945877 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.946193 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.946195 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.946196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.946398 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:26.946491 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:26.947044 (+ 553us) server_negotiation.cc:299] Negotiation successful
0811 07:31:26.947159 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:31:26.948318 2045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.933801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:44191 (local address 127.11.248.3:42095)
0811 07:31:26.934267 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:26.934317 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:26.935785 (+ 1468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:26.936380 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:26.936387 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:26.936915 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:26.937676 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.937696 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.939131 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.939134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.940340 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.940349 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.941055 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.941058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.941203 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.941861 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:26.941878 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:26.943519 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:26.945417 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:26.945424 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:26.945439 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:26.945710 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:26.945963 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:26.945965 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:26.945966 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:26.946113 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:26.946510 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:26.946515 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:26.946776 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 07:31:26.946999 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 07:31:26.947342 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":121,"threads_started":1}
I20260811 07:31:26.949813 2043 heartbeater.cc:347] Connected to a master server at 127.11.248.62:44191
I20260811 07:31:26.950081 2043 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:26.950706 2043 heartbeater.cc:511] Master 127.11.248.62:44191 requested a full tablet report, sending...
I20260811 07:31:26.951965 1530 ts_manager.cc:194] Registered new tserver with Master: 3db75537b3c1425e91934c5fad8cc422 (127.11.248.3:39195)
I20260811 07:31:26.952632 1530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.248.3@KRBTEST.COM'} at 127.11.248.3:42095
I20260811 07:31:26.964892 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:31:26.975708 1575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.967333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55210 (local address 127.11.248.62:44191)
0811 07:31:26.967525 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.967529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.967646 (+ 117us) server_negotiation.cc:407] Connection header received
0811 07:31:26.967817 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.967825 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.967872 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.967989 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:26.968741 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.969355 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.970239 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.970499 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.970622 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.972202 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:26.972206 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:26.972209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:26.972245 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:26.973861 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.974335 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.974339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.974340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.974434 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:26.974721 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:26.974726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:26.974728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:26.974984 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:26.975133 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:26.975389 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 07:31:26.975528 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:31:26.979492 1530 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:31:26.982865 1530 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:31:26.999881 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.994147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38216 (local address 127.11.248.3:39195)
0811 07:31:26.994588 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.994602 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.994624 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:31:26.994698 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.994704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.994908 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.995365 (+ 457us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:26.995512 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.996628 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.998244 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.999110 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.999249 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.999423 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:26.999603 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 07:31:26.999705 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":158,"threads_started":1}
I20260811 07:31:26.999871 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.993309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39195 (local address 127.0.0.1:38216)
0811 07:31:26.994117 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:26.994174 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:26.994318 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:26.995109 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:26.995113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:26.995131 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:26.995218 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.995227 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.996768 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.996771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.998092 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.998102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.999253 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.999257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.999381 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.999420 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:31:26.999569 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 07:31:26.999706 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":29,"thread_start_us":128,"threads_started":1}
I20260811 07:31:27.000067 2059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.995008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45079 (local address 127.0.0.1:38492)
0811 07:31:26.995367 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:26.995385 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:26.995474 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:26.996123 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:26.996126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:26.996143 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:26.996261 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.996270 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.997852 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.997857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.998657 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.998666 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.999650 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.999654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.999750 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:26.999790 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 07:31:26.999846 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 07:31:26.999930 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":100,"threads_started":1}
I20260811 07:31:27.000734 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.995312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38492 (local address 127.11.248.1:45079)
0811 07:31:26.995692 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.995726 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.995751 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:31:26.995843 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.995850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.995998 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.996142 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:26.996403 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.997699 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.998809 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.999504 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.000259 (+ 755us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.000419 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.000470 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.000577 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":82,"threads_started":1}
I20260811 07:31:27.001806 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.993456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38682 (local address 127.11.248.2:41275)
0811 07:31:26.994477 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:26.994490 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:26.994518 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:31:26.994583 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:26.994587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:26.994743 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:26.994921 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:26.995324 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.996585 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.999217 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.000931 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.001049 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.001182 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.001538 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.001641 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":910,"thread_start_us":147,"threads_started":1}
I20260811 07:31:27.002254 2056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:26.993231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:41275 (local address 127.0.0.1:38682)
0811 07:31:26.994116 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:26.994174 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:26.994318 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:26.994914 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:26.994922 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:26.994941 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:26.995168 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.995176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:26.996754 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:26.996758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:26.999058 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:26.999072 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.001250 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.001253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.001366 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.001389 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:31:27.001474 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:31:27.002118 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"mutex_wait_us":116,"thread_start_us":129,"threads_started":1}
I20260811 07:31:27.003582 1670 tablet_service.cc:1467] Processing CreateTablet for tablet e479e8ba66244483b0ddfec487241842 (DEFAULT_TABLE table=test-table [id=46ca719a8570497d9ae05a548c88bdad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:27.003556 1968 tablet_service.cc:1467] Processing CreateTablet for tablet e479e8ba66244483b0ddfec487241842 (DEFAULT_TABLE table=test-table [id=46ca719a8570497d9ae05a548c88bdad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:27.004870 1670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e479e8ba66244483b0ddfec487241842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:27.004877 1968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e479e8ba66244483b0ddfec487241842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:27.005345 1819 tablet_service.cc:1467] Processing CreateTablet for tablet e479e8ba66244483b0ddfec487241842 (DEFAULT_TABLE table=test-table [id=46ca719a8570497d9ae05a548c88bdad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:27.006538 1819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e479e8ba66244483b0ddfec487241842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:27.011602 2063 tablet_bootstrap.cc:492] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Bootstrap starting.
I20260811 07:31:27.013453 2064 tablet_bootstrap.cc:492] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: Bootstrap starting.
I20260811 07:31:27.013895 2063 tablet_bootstrap.cc:654] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:27.014559 2066 tablet_bootstrap.cc:492] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Bootstrap starting.
I20260811 07:31:27.015332 2063 log.cc:824] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:27.015810 2064 tablet_bootstrap.cc:654] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:27.016719 2064 log.cc:824] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:27.017204 2066 tablet_bootstrap.cc:654] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:27.017549 2063 tablet_bootstrap.cc:492] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: No bootstrap required, opened a new log
I20260811 07:31:27.017765 2063 ts_tablet_manager.cc:1397] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:31:27.017982 2066 log.cc:824] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:27.018929 2064 tablet_bootstrap.cc:492] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: No bootstrap required, opened a new log
I20260811 07:31:27.019121 2064 ts_tablet_manager.cc:1397] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 07:31:27.019959 2066 tablet_bootstrap.cc:492] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: No bootstrap required, opened a new log
I20260811 07:31:27.020146 2066 ts_tablet_manager.cc:1397] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 07:31:27.021574 2063 raft_consensus.cc:348] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.022032 2063 raft_consensus.cc:374] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:27.022161 2063 raft_consensus.cc:729] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3db75537b3c1425e91934c5fad8cc422, State: Initialized, Role: FOLLOWER
I20260811 07:31:27.022773 2063 consensus_queue.cc:260] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.023720 2043 heartbeater.cc:503] Master 127.11.248.62:44191 was elected leader, sending a full tablet report...
I20260811 07:31:27.023816 2064 raft_consensus.cc:348] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.024097 2063 ts_tablet_manager.cc:1428] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:31:27.024101 2064 raft_consensus.cc:374] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:27.024159 2064 raft_consensus.cc:729] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddea6f99f0dc4345a43e0f7a2743dd1d, State: Initialized, Role: FOLLOWER
I20260811 07:31:27.024627 2064 consensus_queue.cc:260] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.025425 1743 heartbeater.cc:503] Master 127.11.248.62:44191 was elected leader, sending a full tablet report...
I20260811 07:31:27.025542 2066 raft_consensus.cc:348] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.025838 2066 raft_consensus.cc:374] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:27.025942 2066 raft_consensus.cc:729] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 237c2dc920b84086bcd1ab4c66810c1f, State: Initialized, Role: FOLLOWER
I20260811 07:31:27.026384 2066 consensus_queue.cc:260] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.027223 1893 heartbeater.cc:503] Master 127.11.248.62:44191 was elected leader, sending a full tablet report...
I20260811 07:31:27.027491 2066 ts_tablet_manager.cc:1428] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 07:31:27.028544 2064 ts_tablet_manager.cc:1428] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:31:27.066634 2072 raft_consensus.cc:482] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:27.066947 2072 raft_consensus.cc:504] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.068516 2072 leader_election.cc:288] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3db75537b3c1425e91934c5fad8cc422 (127.11.248.3:39195), ddea6f99f0dc4345a43e0f7a2743dd1d (127.11.248.1:45079)
I20260811 07:31:27.073673 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.068955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:43935 (local address 127.11.248.3:39195)
0811 07:31:27.069137 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:27.069144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:27.069165 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:31:27.069232 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:27.069235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:27.069310 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:27.069407 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:27.069871 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.070681 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.072317 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.073023 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.073153 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.073209 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.073457 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.073534 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:31:27.073693 1895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.068782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39195 (local address 127.11.248.2:43935)
0811 07:31:27.068974 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:27.068994 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:27.069134 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:27.069549 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:27.069553 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:27.069572 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:27.069701 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.069712 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.070840 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.070843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.072166 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.072178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.073166 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.073170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.073307 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.073337 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:31:27.073435 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:31:27.073533 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260811 07:31:27.074194 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.069356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:57551 (local address 127.11.248.1:45079)
0811 07:31:27.069489 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:27.069494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:27.069802 (+ 308us) server_negotiation.cc:407] Connection header received
0811 07:31:27.069934 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:27.069937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:27.069985 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:27.070069 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:27.070393 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.071156 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.072682 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.073400 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.073523 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.073575 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.073955 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.074061 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:31:27.074512 1990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e479e8ba66244483b0ddfec487241842" candidate_uuid: "237c2dc920b84086bcd1ab4c66810c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3db75537b3c1425e91934c5fad8cc422" is_pre_election: true
I20260811 07:31:27.074630 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.069162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45079 (local address 127.11.248.2:57551)
0811 07:31:27.069689 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:27.069705 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:27.069816 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:27.070123 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:27.070126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:27.070146 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:27.070269 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.070276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.071293 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.071297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.072534 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.072543 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.073638 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.073641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.073760 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.073791 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:31:27.074365 (+ 574us) client_negotiation.cc:240] Negotiation successful
0811 07:31:27.074459 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":181,"threads_started":1}
I20260811 07:31:27.074888 1990 raft_consensus.cc:2454] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 237c2dc920b84086bcd1ab4c66810c1f in term 0.
I20260811 07:31:27.075515 1767 leader_election.cc:302] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 237c2dc920b84086bcd1ab4c66810c1f, 3db75537b3c1425e91934c5fad8cc422; no voters:
I20260811 07:31:27.075906 2072 raft_consensus.cc:2781] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:31:27.075867 1692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e479e8ba66244483b0ddfec487241842" candidate_uuid: "237c2dc920b84086bcd1ab4c66810c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" is_pre_election: true
I20260811 07:31:27.076023 2072 raft_consensus.cc:482] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:31:27.076071 2072 raft_consensus.cc:3037] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:27.076201 1692 raft_consensus.cc:2454] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 237c2dc920b84086bcd1ab4c66810c1f in term 0.
I20260811 07:31:27.077505 2072 raft_consensus.cc:504] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.077885 2072 leader_election.cc:288] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [CANDIDATE]: Term 1 election: Requested vote from peers 3db75537b3c1425e91934c5fad8cc422 (127.11.248.3:39195), ddea6f99f0dc4345a43e0f7a2743dd1d (127.11.248.1:45079)
I20260811 07:31:27.078325 1990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e479e8ba66244483b0ddfec487241842" candidate_uuid: "237c2dc920b84086bcd1ab4c66810c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3db75537b3c1425e91934c5fad8cc422"
I20260811 07:31:27.078397 1692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e479e8ba66244483b0ddfec487241842" candidate_uuid: "237c2dc920b84086bcd1ab4c66810c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d"
I20260811 07:31:27.078480 1990 raft_consensus.cc:3037] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:27.078528 1692 raft_consensus.cc:3037] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:27.079888 1692 raft_consensus.cc:2454] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 237c2dc920b84086bcd1ab4c66810c1f in term 1.
I20260811 07:31:27.079888 1990 raft_consensus.cc:2454] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 237c2dc920b84086bcd1ab4c66810c1f in term 1.
I20260811 07:31:27.080268 1767 leader_election.cc:302] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 237c2dc920b84086bcd1ab4c66810c1f, ddea6f99f0dc4345a43e0f7a2743dd1d; no voters:
I20260811 07:31:27.080469 2072 raft_consensus.cc:2781] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:27.080719 2072 raft_consensus.cc:686] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 1 LEADER]: Becoming Leader. State: Replica: 237c2dc920b84086bcd1ab4c66810c1f, State: Running, Role: LEADER
I20260811 07:31:27.081138 2072 consensus_queue.cc:237] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } }
I20260811 07:31:27.084690 1530 catalog_manager.cc:5495] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 237c2dc920b84086bcd1ab4c66810c1f (127.11.248.2). New cstate: current_term: 1 leader_uuid: "237c2dc920b84086bcd1ab4c66810c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "237c2dc920b84086bcd1ab4c66810c1f" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 } health_report { overall_health: UNKNOWN } } }
I20260811 07:31:27.101712 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.097757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38694 (local address 127.11.248.2:41275)
0811 07:31:27.097890 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:27.097893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:27.097907 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:31:27.098067 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:27.098070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:27.098133 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:27.098232 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:31:27.098560 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.099061 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.100080 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.100295 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.100380 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.100761 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:31:27.101303 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:31:27.101401 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.101519 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.101580 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:31:27.108703 1990 raft_consensus.cc:1261] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 1 FOLLOWER]: Refusing update from remote peer 237c2dc920b84086bcd1ab4c66810c1f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:27.108703 1692 raft_consensus.cc:1261] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d [term 1 FOLLOWER]: Refusing update from remote peer 237c2dc920b84086bcd1ab4c66810c1f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:27.109686 2072 consensus_queue.cc:1035] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddea6f99f0dc4345a43e0f7a2743dd1d" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 45079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:27.109958 2074 consensus_queue.cc:1035] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3db75537b3c1425e91934c5fad8cc422" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:27.119060 2080 mvcc.cc:205] Tried to move back new op lower bound from 7317231563187236864 to 7317231563087237120. Current Snapshot: MvccSnapshot[applied={T|T < 7317231563187236864}]
I20260811 07:31:27.129467 1529 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:27.129655 1529 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:27.132905 1529 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 94654816435a4a45935a078416d749e9: Sending DeleteTablet for 3 replicas of tablet e479e8ba66244483b0ddfec487241842
I20260811 07:31:27.133908 1819 tablet_service.cc:1514] Processing DeleteTablet for tablet e479e8ba66244483b0ddfec487241842 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:27 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:38682
I20260811 07:31:27.134057 1670 tablet_service.cc:1514] Processing DeleteTablet for tablet e479e8ba66244483b0ddfec487241842 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:27 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:38492
I20260811 07:31:27.134063 1968 tablet_service.cc:1514] Processing DeleteTablet for tablet e479e8ba66244483b0ddfec487241842 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:27 UTC) from {username='kudu', principal='kudu/127.11.248.62@KRBTEST.COM'} at 127.0.0.1:38216
I20260811 07:31:27.134616 2090 tablet_replica.cc:330] T e479e8ba66244483b0ddfec487241842 P ddea6f99f0dc4345a43e0f7a2743dd1d: stopping tablet replica
I20260811 07:31:27.134776 2088 tablet_replica.cc:330] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: stopping tablet replica
I20260811 07:31:27.134934 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 1602
I20260811 07:31:27.135533 2088 raft_consensus.cc:2229] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:31:27.136016 2088 raft_consensus.cc:2258] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:27.140177 2088 ts_tablet_manager.cc:1905] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:27.140830 2089 tablet_replica.cc:330] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: stopping tablet replica
I20260811 07:31:27.141278 2089 raft_consensus.cc:2229] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:27.141721 2089 raft_consensus.cc:2258] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:27.143462 2089 ts_tablet_manager.cc:1905] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:27.144397 2088 ts_tablet_manager.cc:1918] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:27.144605 2088 log.cc:1196] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/e479e8ba66244483b0ddfec487241842
I20260811 07:31:27.145117 2088 ts_tablet_manager.cc:1939] T e479e8ba66244483b0ddfec487241842 P 237c2dc920b84086bcd1ab4c66810c1f: Deleting consensus metadata
I20260811 07:31:27.146250 2089 ts_tablet_manager.cc:1918] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:27.146440 2089 log.cc:1196] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/e479e8ba66244483b0ddfec487241842
I20260811 07:31:27.146878 2089 ts_tablet_manager.cc:1939] T e479e8ba66244483b0ddfec487241842 P 3db75537b3c1425e91934c5fad8cc422: Deleting consensus metadata
I20260811 07:31:27.146819 1513 catalog_manager.cc:4841] TS 237c2dc920b84086bcd1ab4c66810c1f (127.11.248.2:41275): tablet e479e8ba66244483b0ddfec487241842 (table test-table [id=46ca719a8570497d9ae05a548c88bdad]) successfully deleted
I20260811 07:31:27.148456 1512 catalog_manager.cc:4841] TS 3db75537b3c1425e91934c5fad8cc422 (127.11.248.3:39195): tablet e479e8ba66244483b0ddfec487241842 (table test-table [id=46ca719a8570497d9ae05a548c88bdad]) successfully deleted
I20260811 07:31:27.148654 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 1749
W20260811 07:31:27.148761 1512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:45079 (error 108)
I20260811 07:31:27.151728 2056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.151227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:45079 (local address 127.0.0.1:38508)
0811 07:31:27.151570 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:27.151641 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:45079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261}
W20260811 07:31:27.151926 1512 catalog_manager.cc:4584] TS ddea6f99f0dc4345a43e0f7a2743dd1d (127.11.248.1:45079): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e479e8ba66244483b0ddfec487241842: Network error: Client connection negotiation failed: client connection to 127.11.248.1:45079: connect: Connection refused (error 111)
I20260811 07:31:27.157161 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 1899
I20260811 07:31:27.165360 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 1491
2026-08-11T07:31:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2673 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T07:31:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:27Z Disabled control of system clock
I20260811 07:31:27.204170 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34157
--webserver_interface=127.11.248.62
--webserver_port=0
--builtin_ntp_servers=127.11.248.20:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:34157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:31:27.325002 2097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:27.325318 2097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:27.325357 2097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:27.329560 2097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:27.329639 2097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:27.329655 2097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:27.329674 2097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:27.329689 2097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:27.334930 2097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:34157
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:27.336069 2097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:27.337585 2097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:27.347029 2104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:27.347097 2105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:27.347092 2107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:27.347471 2097 server_base.cc:1034] running on GCE node
I20260811 07:31:27.348084 2097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:27.349567 2097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:27.350783 2097 hybrid_clock.cc:648] HybridClock initialized: now 1786433487350767 us; error 32 us; skew 500 ppm
I20260811 07:31:27.357501 2097 webserver.cc:460] Webserver started at http://127.11.248.62:33455/ using document root <none> and password file <none>
I20260811 07:31:27.358287 2097 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:27.358386 2097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:27.358662 2097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:27.361356 2097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "c3970719eddf4d1bb76e38ad4d4593b2"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "1c39c928c514152faecd044219961a4c"
server_key_iv: "1c01a8108bd8cb8550e1ce8af498a36d"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.362075 2097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "c3970719eddf4d1bb76e38ad4d4593b2"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "1c39c928c514152faecd044219961a4c"
server_key_iv: "1c01a8108bd8cb8550e1ce8af498a36d"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.366555 2097 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:27.369577 2113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.371176 2097 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:27.371407 2097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "c3970719eddf4d1bb76e38ad4d4593b2"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "1c39c928c514152faecd044219961a4c"
server_key_iv: "1c01a8108bd8cb8550e1ce8af498a36d"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.371539 2097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:27.392711 2097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:27.393527 2097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:27.393711 2097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:27.401871 2097 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:34157
I20260811 07:31:27.401890 2170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:34157 every 8 connection(s)
I20260811 07:31:27.403012 2097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:27.406383 2171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:27.412366 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2097
I20260811 07:31:27.412398 2171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2: Bootstrap starting.
I20260811 07:31:27.412497 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:27.412904 12256 external_mini_cluster.cc:1428] Setting key 3613e302ef3e3f0584e72e6833bc3066
I20260811 07:31:27.415462 2171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:27.416340 2171 log.cc:824] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:27.418622 2171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2: No bootstrap required, opened a new log
I20260811 07:31:27.423573 2171 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34157 } }
I20260811 07:31:27.423888 2171 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:27.423993 2171 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3970719eddf4d1bb76e38ad4d4593b2, State: Initialized, Role: FOLLOWER
I20260811 07:31:27.424029 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.414466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.11.248.62:34157)
0811 07:31:27.415292 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:27.415308 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:27.415348 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:31:27.416147 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:27.416168 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:27.416660 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:27.417122 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:27.417545 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.418561 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.419919 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.420474 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.420624 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.421751 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:27.421758 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:27.421774 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:27.422239 (+ 465us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:27.422320 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:27.422342 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:27.422431 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.422655 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.423102 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":167,"threads_started":1}
I20260811 07:31:27.424559 2171 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34157 } }
I20260811 07:31:27.424741 2171 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:27.424834 2171 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:27.424930 2171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:27.426045 2171 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34157 } }
I20260811 07:31:27.426473 2171 leader_election.cc:302] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3970719eddf4d1bb76e38ad4d4593b2; no voters:
I20260811 07:31:27.426918 2171 leader_election.cc:288] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:27.427206 2178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:27.427531 2178 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [term 1 LEADER]: Becoming Leader. State: Replica: c3970719eddf4d1bb76e38ad4d4593b2, State: Running, Role: LEADER
I20260811 07:31:27.427917 2178 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34157 } }
I20260811 07:31:27.428525 2171 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:27.429822 2178 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3970719eddf4d1bb76e38ad4d4593b2. Latest consensus state: current_term: 1 leader_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34157 } } }
I20260811 07:31:27.429955 2178 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:27.430640 2179 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3970719eddf4d1bb76e38ad4d4593b2" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34157 } } }
I20260811 07:31:27.430899 2179 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:27.431573 2187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:27.435099 2187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:27.441082 2187 catalog_manager.cc:1347] Generated new cluster ID: d2d63071f9f845c8afba7fe701ce1bb3
I20260811 07:31:27.441181 2187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:27.460012 2187 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:27.461175 2187 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:27.489890 2187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2: Generated new TSK 0
I20260811 07:31:27.491046 2187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:27.507308 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.1:0
--local_ip_for_outbound_sockets=127.11.248.1
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:34157
--builtin_ntp_servers=127.11.248.20:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:31:27.643491 2199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:27.643859 2199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:27.643913 2199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:27.648524 2199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:27.648622 2199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:27.648721 2199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.1
I20260811 07:31:27.654052 2199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.248.1
--webserver_port=0
--tserver_master_addrs=127.11.248.62:34157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.1
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:27.655414 2199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:27.657156 2199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:27.668334 2205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:27.668334 2207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:27.668355 2204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:27.668509 2199 server_base.cc:1034] running on GCE node
I20260811 07:31:27.669152 2199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:27.669919 2199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:27.671207 2199 hybrid_clock.cc:648] HybridClock initialized: now 1786433487671169 us; error 48 us; skew 500 ppm
I20260811 07:31:27.673799 2199 webserver.cc:460] Webserver started at http://127.11.248.1:43115/ using document root <none> and password file <none>
I20260811 07:31:27.674548 2199 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:27.674628 2199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:27.674880 2199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:27.677481 2199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data/instance:
uuid: "67f4096ae9f84a9a8a9465f668d40a3c"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "abd397f69e00159d77aee645a62fc39c"
server_key_iv: "a2b0ef648b5b848c2a75545f5c464b83"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.678118 2199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance:
uuid: "67f4096ae9f84a9a8a9465f668d40a3c"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "abd397f69e00159d77aee645a62fc39c"
server_key_iv: "a2b0ef648b5b848c2a75545f5c464b83"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.682433 2199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:27.685452 2215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.686969 2199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:27.687143 2199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal
uuid: "67f4096ae9f84a9a8a9465f668d40a3c"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "abd397f69e00159d77aee645a62fc39c"
server_key_iv: "a2b0ef648b5b848c2a75545f5c464b83"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.687290 2199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:27.715453 2199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:27.716404 2199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:27.716616 2199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:27.717721 2199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:27.718935 2199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:27.719033 2199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.719111 2199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:27.719148 2199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.730526 2199 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.1:32915
I20260811 07:31:27.730558 2342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.1:32915 every 8 connection(s)
I20260811 07:31:27.731670 2199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/data/info.pb
I20260811 07:31:27.737874 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2199
I20260811 07:31:27.738037 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-0/wal/instance
I20260811 07:31:27.738399 12256 external_mini_cluster.cc:1428] Setting key 81f9bddcb42a3fb75d84cc6f8c05e9b6
I20260811 07:31:27.741204 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.2:0
--local_ip_for_outbound_sockets=127.11.248.2
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:34157
--builtin_ntp_servers=127.11.248.20:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:31:27.744037 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.733988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.1:49025 (local address 127.11.248.62:34157)
0811 07:31:27.734183 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:27.734187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:27.735385 (+ 1198us) server_negotiation.cc:407] Connection header received
0811 07:31:27.737079 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:27.737083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:27.737158 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:27.737245 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:27.738693 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.739446 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.741400 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.741654 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.741744 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.743371 (+ 1627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:27.743376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:27.743380 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:27.743403 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:27.743429 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:27.743441 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:27.743539 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.743774 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.743862 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:31:27.745451 2345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.734410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34157 (local address 127.11.248.1:49025)
0811 07:31:27.735179 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:27.735227 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:27.736751 (+ 1524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:27.737487 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:27.737495 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:27.737644 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:27.738474 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.738503 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.739648 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.739651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.741240 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.741255 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.741852 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.741858 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.742118 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.742907 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:27.742912 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:27.742978 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:27.743084 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:27.743573 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:27.743587 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:27.743600 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:31:27.743775 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 07:31:27.744215 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":132,"threads_started":1}
I20260811 07:31:27.747220 2343 heartbeater.cc:347] Connected to a master server at 127.11.248.62:34157
I20260811 07:31:27.747558 2343 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:27.748268 2343 heartbeater.cc:511] Master 127.11.248.62:34157 requested a full tablet report, sending...
I20260811 07:31:27.750134 2132 ts_manager.cc:194] Registered new tserver with Master: 67f4096ae9f84a9a8a9465f668d40a3c (127.11.248.1:32915)
I20260811 07:31:27.751382 2132 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.1:49025
W20260811 07:31:27.870494 2347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:27.870826 2347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:27.870919 2347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:27.875408 2347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:27.875532 2347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:27.875633 2347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.2
I20260811 07:31:27.881081 2347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.248.2
--webserver_port=0
--tserver_master_addrs=127.11.248.62:34157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.2
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:27.882356 2347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:27.883864 2347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:31:27.895216 2347 server_base.cc:1034] running on GCE node
W20260811 07:31:27.895192 2352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:27.895159 2353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:27.895159 2356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:27.896168 2347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:27.896989 2347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:27.898170 2347 hybrid_clock.cc:648] HybridClock initialized: now 1786433487898154 us; error 31 us; skew 500 ppm
I20260811 07:31:27.900486 2347 webserver.cc:460] Webserver started at http://127.11.248.2:45817/ using document root <none> and password file <none>
I20260811 07:31:27.901321 2347 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:27.901415 2347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:27.901683 2347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:27.904104 2347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data/instance:
uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "03dc6be4a7f5378d97816e4a2c124853"
server_key_iv: "54d81aee87fbf18b08ca86de8aa75e23"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.904886 2347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance:
uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "03dc6be4a7f5378d97816e4a2c124853"
server_key_iv: "54d81aee87fbf18b08ca86de8aa75e23"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.909791 2347 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:31:27.912911 2362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.914496 2347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 07:31:27.914638 2347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal
uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b"
format_stamp: "Formatted at 2026-08-11 07:31:27 on dist-test-slave-77v9"
server_key: "03dc6be4a7f5378d97816e4a2c124853"
server_key_iv: "54d81aee87fbf18b08ca86de8aa75e23"
server_key_version: "encryptionkey@0"
I20260811 07:31:27.914759 2347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:27.930078 2347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:27.930987 2347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:27.931248 2347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:27.931936 2347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:27.933162 2347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:27.933219 2347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.933261 2347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:27.933276 2347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:27.943037 2347 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.2:39961
I20260811 07:31:27.943080 2490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.2:39961 every 8 connection(s)
I20260811 07:31:27.944118 2347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/data/info.pb
I20260811 07:31:27.951793 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2347
I20260811 07:31:27.951972 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal/instance
I20260811 07:31:27.952291 12256 external_mini_cluster.cc:1428] Setting key 29f641ce8ddf1da7bdab446006386279
I20260811 07:31:27.954721 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.248.3:0
--local_ip_for_outbound_sockets=127.11.248.3
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:34157
--builtin_ntp_servers=127.11.248.20:42467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:31:27.955376 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.946374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.2:60309 (local address 127.11.248.62:34157)
0811 07:31:27.946573 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:27.946579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:27.947955 (+ 1376us) server_negotiation.cc:407] Connection header received
0811 07:31:27.949541 (+ 1586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:27.949552 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:27.949618 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:27.949705 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:27.950788 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.951343 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.952688 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.953041 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.953160 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.954658 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:27.954662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:27.954664 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:27.954679 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:27.954703 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:27.954714 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:27.954800 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:27.955083 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 07:31:27.955169 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:31:27.956410 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:27.946849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34157 (local address 127.11.248.2:60309)
0811 07:31:27.947665 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:27.947762 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:27.949273 (+ 1511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:27.949940 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:27.949947 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:27.950039 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:27.950549 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.950562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.951492 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.951494 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.952552 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:27.952563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:27.953273 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:27.953278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:27.953488 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:27.954347 (+ 859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:27.954348 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:27.954391 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:27.954481 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:27.954873 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:27.954886 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:27.954896 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:31:27.955045 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 07:31:27.955407 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":131,"threads_started":1}
I20260811 07:31:27.957659 2491 heartbeater.cc:347] Connected to a master server at 127.11.248.62:34157
I20260811 07:31:27.957949 2491 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:27.958633 2491 heartbeater.cc:511] Master 127.11.248.62:34157 requested a full tablet report, sending...
I20260811 07:31:27.959825 2132 ts_manager.cc:194] Registered new tserver with Master: 5acda6a1c2cc40dcbcf014c4ba8a531b (127.11.248.2:39961)
I20260811 07:31:27.960474 2132 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.2:60309
W20260811 07:31:28.078913 2495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:28.079263 2495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:28.079308 2495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:28.083781 2495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:28.083860 2495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:28.083920 2495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.248.3
I20260811 07:31:28.089102 2495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.248.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.248.3
--webserver_port=0
--tserver_master_addrs=127.11.248.62:34157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.248.3
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:28.090405 2495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:28.092000 2495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:28.103060 2501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:28.103176 2500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:28.103106 2504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:28.103631 2495 server_base.cc:1034] running on GCE node
I20260811 07:31:28.104123 2495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:28.104910 2495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:28.106099 2495 hybrid_clock.cc:648] HybridClock initialized: now 1786433488106081 us; error 38 us; skew 500 ppm
I20260811 07:31:28.108341 2495 webserver.cc:460] Webserver started at http://127.11.248.3:40909/ using document root <none> and password file <none>
I20260811 07:31:28.109086 2495 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:28.109190 2495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:28.109475 2495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:28.111696 2495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data/instance:
uuid: "d56f10fee9b749b591d0d406671aa998"
format_stamp: "Formatted at 2026-08-11 07:31:28 on dist-test-slave-77v9"
server_key: "ac30657ec20a6f388ec3e4b546401a06"
server_key_iv: "2a3868460516de9a891566e89c428ab8"
server_key_version: "encryptionkey@0"
I20260811 07:31:28.112318 2495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance:
uuid: "d56f10fee9b749b591d0d406671aa998"
format_stamp: "Formatted at 2026-08-11 07:31:28 on dist-test-slave-77v9"
server_key: "ac30657ec20a6f388ec3e4b546401a06"
server_key_iv: "2a3868460516de9a891566e89c428ab8"
server_key_version: "encryptionkey@0"
I20260811 07:31:28.116526 2495 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:31:28.119455 2510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:28.121351 2495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:28.121510 2495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal
uuid: "d56f10fee9b749b591d0d406671aa998"
format_stamp: "Formatted at 2026-08-11 07:31:28 on dist-test-slave-77v9"
server_key: "ac30657ec20a6f388ec3e4b546401a06"
server_key_iv: "2a3868460516de9a891566e89c428ab8"
server_key_version: "encryptionkey@0"
I20260811 07:31:28.121655 2495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:28.137988 2495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:28.138765 2495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:28.138988 2495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:28.139621 2495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:31:28.140657 2495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:31:28.140712 2495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:28.140760 2495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:31:28.140777 2495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:28.151000 2495 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.3:39457
I20260811 07:31:28.151126 2637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.3:39457 every 8 connection(s)
I20260811 07:31:28.152053 2495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/data/info.pb
I20260811 07:31:28.154356 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2495
I20260811 07:31:28.154522 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal/instance
I20260811 07:31:28.154901 12256 external_mini_cluster.cc:1428] Setting key 861a4f54e8204512a4e9ce9f6c6a302c
I20260811 07:31:28.163255 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.154254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:45141 (local address 127.11.248.62:34157)
0811 07:31:28.154404 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.154407 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.156075 (+ 1668us) server_negotiation.cc:407] Connection header received
0811 07:31:28.157935 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.157938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.157989 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.158066 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:28.159143 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.159735 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.161218 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.161472 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.161567 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.162798 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:28.162802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:28.162804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:28.162817 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:28.162837 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:28.162845 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:28.162911 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.163073 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.163130 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 07:31:28.164273 2640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.154886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:34157 (local address 127.11.248.3:45141)
0811 07:31:28.155830 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.155890 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:28.157712 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:28.158289 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:28.158298 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:28.158395 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:28.158990 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.159004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.159946 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.159950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.161090 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.161101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.161654 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.161658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.161840 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.162513 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:31:28.162515 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:28.162557 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:31:28.162628 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:28.162935 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:28.162942 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:28.162947 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 07:31:28.163058 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:31:28.163298 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":177,"threads_started":1}
I20260811 07:31:28.166071 2638 heartbeater.cc:347] Connected to a master server at 127.11.248.62:34157
I20260811 07:31:28.166373 2638 heartbeater.cc:464] Registering TS with master...
I20260811 07:31:28.167084 2638 heartbeater.cc:511] Master 127.11.248.62:34157 requested a full tablet report, sending...
I20260811 07:31:28.168401 2132 ts_manager.cc:194] Registered new tserver with Master: d56f10fee9b749b591d0d406671aa998 (127.11.248.3:39457)
I20260811 07:31:28.169101 2132 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.248.3:45141
I20260811 07:31:28.169744 12256 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:31:28.175906 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.171975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.11.248.62:34157)
0811 07:31:28.172109 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.172114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.172177 (+ 63us) server_negotiation.cc:407] Connection header received
0811 07:31:28.172304 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.172306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.172346 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.172422 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:28.172732 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.173366 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.174321 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.174539 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.174632 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.175475 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:28.175478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:28.175480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:28.175493 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:28.175510 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:28.175517 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:28.175576 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.175717 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.175777 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:31:28.179111 2130 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:31:28.182354 2130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:31:28.198612 2650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.192123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:32915 (local address 127.0.0.1:55580)
0811 07:31:28.192747 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.192906 (+ 159us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:28.193061 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:28.193850 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:28.193856 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:28.193881 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:28.194051 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.194060 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.195365 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.195371 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.196778 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.196790 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.197952 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.197956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.198088 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.198135 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 07:31:28.198268 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 07:31:28.198430 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"mutex_wait_us":44,"thread_start_us":87,"threads_started":1}
I20260811 07:31:28.198632 2652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.192245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55580 (local address 127.11.248.1:32915)
0811 07:31:28.192965 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.192973 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.193001 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:31:28.193232 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.193240 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.193499 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.193665 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:28.194183 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.195248 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.196962 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.197812 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.197938 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.198153 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.198304 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.198444 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":88,"threads_started":1}
I20260811 07:31:28.198977 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.193013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54096 (local address 127.11.248.3:39457)
0811 07:31:28.193806 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.193818 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.194463 (+ 645us) server_negotiation.cc:407] Connection header received
0811 07:31:28.194544 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.194549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.194717 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.194871 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:28.195106 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.196045 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.197599 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.198299 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.198400 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.198568 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.198680 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.198793 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":154,"threads_started":1}
I20260811 07:31:28.199113 2653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.192541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.3:39457 (local address 127.0.0.1:54096)
0811 07:31:28.194336 (+ 1795us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.194351 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:28.194449 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:28.194881 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:28.194884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:28.194902 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:28.194988 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.194993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.196177 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.196180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.197472 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.197481 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.198441 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.198445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.198545 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.198570 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:31:28.198655 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:31:28.198739 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1732,"mutex_wait_us":25,"thread_start_us":91,"threads_started":1}
I20260811 07:31:28.199575 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.192226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:39961 (local address 127.0.0.1:42482)
0811 07:31:28.193414 (+ 1188us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.193427 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:28.193549 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:28.194090 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:28.194092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:28.194113 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:28.194228 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.194233 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.195752 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.195755 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.196901 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.196909 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.198978 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.198982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.199250 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.199278 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:31:28.199352 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 07:31:28.199437 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1129,"mutex_wait_us":1,"thread_start_us":163,"threads_started":1}
I20260811 07:31:28.200054 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.193011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42482 (local address 127.11.248.2:39961)
0811 07:31:28.193644 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.193655 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.193677 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:31:28.193748 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.193752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.193940 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.194094 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:28.194351 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.195622 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.197032 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.197812 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.197938 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.198152 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.199763 (+ 1611us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.199886 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":152,"threads_started":1}
I20260811 07:31:28.202473 2414 tablet_service.cc:1467] Processing CreateTablet for tablet cfb9a12dcdde4919879737523e84c518 (DEFAULT_TABLE table=test-table [id=781d1cba06064d7b9ff53fc5362251ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:28.202306 2562 tablet_service.cc:1467] Processing CreateTablet for tablet cfb9a12dcdde4919879737523e84c518 (DEFAULT_TABLE table=test-table [id=781d1cba06064d7b9ff53fc5362251ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:28.202306 2269 tablet_service.cc:1467] Processing CreateTablet for tablet cfb9a12dcdde4919879737523e84c518 (DEFAULT_TABLE table=test-table [id=781d1cba06064d7b9ff53fc5362251ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:31:28.203473 2414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb9a12dcdde4919879737523e84c518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:28.203495 2269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb9a12dcdde4919879737523e84c518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:28.203495 2562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb9a12dcdde4919879737523e84c518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:28.211292 2661 tablet_bootstrap.cc:492] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Bootstrap starting.
I20260811 07:31:28.212245 2659 tablet_bootstrap.cc:492] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: Bootstrap starting.
I20260811 07:31:28.213198 2657 tablet_bootstrap.cc:492] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Bootstrap starting.
I20260811 07:31:28.213763 2661 tablet_bootstrap.cc:654] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:28.214427 2659 tablet_bootstrap.cc:654] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:28.214576 2661 log.cc:824] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:28.215210 2657 tablet_bootstrap.cc:654] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:28.215262 2659 log.cc:824] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:28.216066 2657 log.cc:824] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:28.217020 2661 tablet_bootstrap.cc:492] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: No bootstrap required, opened a new log
I20260811 07:31:28.217257 2661 ts_tablet_manager.cc:1397] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:31:28.217702 2659 tablet_bootstrap.cc:492] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: No bootstrap required, opened a new log
I20260811 07:31:28.217916 2659 ts_tablet_manager.cc:1397] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:31:28.217944 2657 tablet_bootstrap.cc:492] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: No bootstrap required, opened a new log
I20260811 07:31:28.218142 2657 ts_tablet_manager.cc:1397] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 07:31:28.221609 2657 raft_consensus.cc:348] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.221910 2657 raft_consensus.cc:374] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:28.222002 2657 raft_consensus.cc:729] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56f10fee9b749b591d0d406671aa998, State: Initialized, Role: FOLLOWER
I20260811 07:31:28.222033 2659 raft_consensus.cc:348] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.222023 2661 raft_consensus.cc:348] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.222285 2661 raft_consensus.cc:374] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:28.222285 2659 raft_consensus.cc:374] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:28.222344 2661 raft_consensus.cc:729] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5acda6a1c2cc40dcbcf014c4ba8a531b, State: Initialized, Role: FOLLOWER
I20260811 07:31:28.222353 2659 raft_consensus.cc:729] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f4096ae9f84a9a8a9465f668d40a3c, State: Initialized, Role: FOLLOWER
I20260811 07:31:28.222591 2657 consensus_queue.cc:260] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.222767 2659 consensus_queue.cc:260] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.222767 2661 consensus_queue.cc:260] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.223778 2661 ts_tablet_manager.cc:1428] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260811 07:31:28.223778 2659 ts_tablet_manager.cc:1428] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260811 07:31:28.223779 2657 ts_tablet_manager.cc:1428] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:31:28.224148 2491 heartbeater.cc:503] Master 127.11.248.62:34157 was elected leader, sending a full tablet report...
I20260811 07:31:28.224148 2343 heartbeater.cc:503] Master 127.11.248.62:34157 was elected leader, sending a full tablet report...
I20260811 07:31:28.224169 2638 heartbeater.cc:503] Master 127.11.248.62:34157 was elected leader, sending a full tablet report...
W20260811 07:31:28.233129 2344 tablet.cc:2369] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:31:28.236088 2665 raft_consensus.cc:482] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:31:28.236332 2665 raft_consensus.cc:504] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.237630 2665 leader_election.cc:288] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f4096ae9f84a9a8a9465f668d40a3c (127.11.248.1:32915), 5acda6a1c2cc40dcbcf014c4ba8a531b (127.11.248.2:39961)
I20260811 07:31:28.243170 2640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.237898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.2:39961 (local address 127.11.248.3:56945)
0811 07:31:28.238058 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.238076 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:28.238188 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:28.238551 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:28.238557 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:28.238579 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:28.238717 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.238724 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.239869 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.239872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.241387 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.241392 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.242497 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.242500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.242692 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.242751 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 07:31:28.242842 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:31:28.242975 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":194}
I20260811 07:31:28.243173 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.238036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:56945 (local address 127.11.248.2:39961)
0811 07:31:28.238162 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.238167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.238183 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:31:28.238324 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.238328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.238393 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.238461 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:28.238853 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.239655 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.241565 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.242320 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.242471 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.242530 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.242965 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.243061 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:31:28.243170 2652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.238050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.248.3:44347 (local address 127.11.248.1:32915)
0811 07:31:28.238198 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.238205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.238571 (+ 366us) server_negotiation.cc:407] Connection header received
0811 07:31:28.238706 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.238708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.238749 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.238854 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:31:28.239122 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.239842 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.241565 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.242255 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.242471 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.242530 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.242927 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.243028 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:31:28.243692 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.237898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:32915 (local address 127.11.248.3:44347)
0811 07:31:28.238425 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.238495 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:28.238587 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:28.238888 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:28.238890 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:28.238910 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:31:28.239005 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.239008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.239947 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.239950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.241378 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:28.241391 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.242496 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.242500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:28.242671 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.242747 (+ 76us) client_negotiation.cc:769] Sending connection context
0811 07:31:28.242843 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:31:28.242975 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":267,"thread_start_us":158,"threads_started":1}
I20260811 07:31:28.244179 2437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb9a12dcdde4919879737523e84c518" candidate_uuid: "d56f10fee9b749b591d0d406671aa998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" is_pre_election: true
I20260811 07:31:28.244446 2291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb9a12dcdde4919879737523e84c518" candidate_uuid: "d56f10fee9b749b591d0d406671aa998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" is_pre_election: true
I20260811 07:31:28.244551 2437 raft_consensus.cc:2454] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56f10fee9b749b591d0d406671aa998 in term 0.
I20260811 07:31:28.244724 2291 raft_consensus.cc:2454] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d56f10fee9b749b591d0d406671aa998 in term 0.
I20260811 07:31:28.245249 2514 leader_election.cc:302] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5acda6a1c2cc40dcbcf014c4ba8a531b, 67f4096ae9f84a9a8a9465f668d40a3c, d56f10fee9b749b591d0d406671aa998; no voters:
I20260811 07:31:28.245640 2665 raft_consensus.cc:2781] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:31:28.245734 2665 raft_consensus.cc:482] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:31:28.245780 2665 raft_consensus.cc:3037] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:28.246888 2665 raft_consensus.cc:504] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.247272 2665 leader_election.cc:288] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [CANDIDATE]: Term 1 election: Requested vote from peers 67f4096ae9f84a9a8a9465f668d40a3c (127.11.248.1:32915), 5acda6a1c2cc40dcbcf014c4ba8a531b (127.11.248.2:39961)
I20260811 07:31:28.247764 2437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb9a12dcdde4919879737523e84c518" candidate_uuid: "d56f10fee9b749b591d0d406671aa998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b"
I20260811 07:31:28.247911 2437 raft_consensus.cc:3037] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:28.247902 2291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb9a12dcdde4919879737523e84c518" candidate_uuid: "d56f10fee9b749b591d0d406671aa998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f4096ae9f84a9a8a9465f668d40a3c"
I20260811 07:31:28.248070 2291 raft_consensus.cc:3037] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:28.249059 2437 raft_consensus.cc:2454] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56f10fee9b749b591d0d406671aa998 in term 1.
I20260811 07:31:28.249428 2291 raft_consensus.cc:2454] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d56f10fee9b749b591d0d406671aa998 in term 1.
I20260811 07:31:28.249459 2514 leader_election.cc:302] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5acda6a1c2cc40dcbcf014c4ba8a531b, d56f10fee9b749b591d0d406671aa998; no voters:
I20260811 07:31:28.249675 2665 raft_consensus.cc:2781] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:28.249996 2665 raft_consensus.cc:686] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 1 LEADER]: Becoming Leader. State: Replica: d56f10fee9b749b591d0d406671aa998, State: Running, Role: LEADER
I20260811 07:31:28.250432 2665 consensus_queue.cc:237] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } }
I20260811 07:31:28.254323 2131 catalog_manager.cc:5495] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 reported cstate change: term changed from 0 to 1, leader changed from <none> to d56f10fee9b749b591d0d406671aa998 (127.11.248.3). New cstate: current_term: 1 leader_uuid: "d56f10fee9b749b591d0d406671aa998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d56f10fee9b749b591d0d406671aa998" member_type: VOTER last_known_addr { host: "127.11.248.3" port: 39457 } health_report { overall_health: HEALTHY } } }
I20260811 07:31:28.266533 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.262261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54100 (local address 127.11.248.3:39457)
0811 07:31:28.262421 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:28.262425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:28.262440 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:31:28.262612 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:28.262615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:28.262677 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:28.262774 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:31:28.263069 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.263699 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.264630 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:28.264905 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:28.265045 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:28.265383 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:31:28.266029 (+ 646us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:31:28.266173 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:28.266244 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 07:31:28.266307 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:31:28.273483 2437 raft_consensus.cc:1261] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 1 FOLLOWER]: Refusing update from remote peer d56f10fee9b749b591d0d406671aa998: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:28.273483 2291 raft_consensus.cc:1261] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c [term 1 FOLLOWER]: Refusing update from remote peer d56f10fee9b749b591d0d406671aa998: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:28.274341 2670 consensus_queue.cc:1035] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f4096ae9f84a9a8a9465f668d40a3c" member_type: VOTER last_known_addr { host: "127.11.248.1" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:28.274542 2665 consensus_queue.cc:1035] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5acda6a1c2cc40dcbcf014c4ba8a531b" member_type: VOTER last_known_addr { host: "127.11.248.2" port: 39961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:28.283106 2675 mvcc.cc:205] Tried to move back new op lower bound from 7317231567960440832 to 7317231567877038080. Current Snapshot: MvccSnapshot[applied={T|T < 7317231567960440832}]
I20260811 07:31:28.283289 2674 mvcc.cc:205] Tried to move back new op lower bound from 7317231567960440832 to 7317231567877038080. Current Snapshot: MvccSnapshot[applied={T|T < 7317231567960440832}]
I20260811 07:31:28.292886 2131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:28.293100 2131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:31:28.295858 2131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3970719eddf4d1bb76e38ad4d4593b2: Sending DeleteTablet for 3 replicas of tablet cfb9a12dcdde4919879737523e84c518
I20260811 07:31:28.296785 2269 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb9a12dcdde4919879737523e84c518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:28 UTC) from {username='slave'} at 127.0.0.1:55580
I20260811 07:31:28.296803 2562 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb9a12dcdde4919879737523e84c518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:28 UTC) from {username='slave'} at 127.0.0.1:54096
I20260811 07:31:28.296900 2414 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb9a12dcdde4919879737523e84c518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:31:28 UTC) from {username='slave'} at 127.0.0.1:42482
I20260811 07:31:28.297432 2687 tablet_replica.cc:330] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: stopping tablet replica
I20260811 07:31:28.297695 2685 tablet_replica.cc:330] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: stopping tablet replica
I20260811 07:31:28.297789 2687 raft_consensus.cc:2229] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:31:28.297963 2684 tablet_replica.cc:330] T cfb9a12dcdde4919879737523e84c518 P 67f4096ae9f84a9a8a9465f668d40a3c: stopping tablet replica
I20260811 07:31:28.298050 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2199
I20260811 07:31:28.298166 2687 raft_consensus.cc:2258] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:28.299952 2685 raft_consensus.cc:2229] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:31:28.300762 2685 raft_consensus.cc:2258] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:31:28.302904 2685 ts_tablet_manager.cc:1905] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:28.302944 2687 ts_tablet_manager.cc:1905] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:31:28.305735 2687 ts_tablet_manager.cc:1918] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:28.305848 2687 log.cc:1196] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-1/wal/wals/cfb9a12dcdde4919879737523e84c518
I20260811 07:31:28.306169 2687 ts_tablet_manager.cc:1939] T cfb9a12dcdde4919879737523e84c518 P 5acda6a1c2cc40dcbcf014c4ba8a531b: Deleting consensus metadata
I20260811 07:31:28.306788 2685 ts_tablet_manager.cc:1918] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:31:28.306962 2685 log.cc:1196] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Deleting WAL directory at /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433213255187-12256-0/minicluster-data/ts-2/wal/wals/cfb9a12dcdde4919879737523e84c518
I20260811 07:31:28.307372 2685 ts_tablet_manager.cc:1939] T cfb9a12dcdde4919879737523e84c518 P d56f10fee9b749b591d0d406671aa998: Deleting consensus metadata
I20260811 07:31:28.307590 2118 catalog_manager.cc:4841] TS 5acda6a1c2cc40dcbcf014c4ba8a531b (127.11.248.2:39961): tablet cfb9a12dcdde4919879737523e84c518 (table test-table [id=781d1cba06064d7b9ff53fc5362251ef]) successfully deleted
I20260811 07:31:28.308703 2119 catalog_manager.cc:4841] TS d56f10fee9b749b591d0d406671aa998 (127.11.248.3:39457): tablet cfb9a12dcdde4919879737523e84c518 (table test-table [id=781d1cba06064d7b9ff53fc5362251ef]) successfully deleted
W20260811 07:31:28.309598 2117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.248.1:32915 (error 108)
I20260811 07:31:28.309791 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2347
I20260811 07:31:28.313897 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:28.313525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.1:32915 (local address 127.0.0.1:55582)
0811 07:31:28.313691 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:28.313787 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.1:32915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:31:28.314106 2117 catalog_manager.cc:4584] TS 67f4096ae9f84a9a8a9465f668d40a3c (127.11.248.1:32915): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cfb9a12dcdde4919879737523e84c518: Network error: Client connection negotiation failed: client connection to 127.11.248.1:32915: connect: Connection refused (error 111)
I20260811 07:31:28.319006 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2495
I20260811 07:31:28.326944 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2097
2026-08-11T07:31:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1158 ms)
[----------] 6 tests from EncryptionPolicyTest (11521 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:28 dist-test-slave-77v9 krb5kdc[2691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:28 dist-test-slave-77v9 krb5kdc[2691](info): set up 2 sockets
Aug 11 07:31:28 dist-test-slave-77v9 krb5kdc[2691](info): commencing operation
krb5kdc: starting...
W20260811 07:31:29.461191 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:29 dist-test-slave-77v9 krb5kdc[2691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:29.621881 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37465
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:29.745034 2707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:29.745430 2707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:29.745515 2707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:29.749836 2707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:29.750000 2707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:29.750041 2707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:29.750075 2707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:29.750133 2707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:29.755977 2707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37465
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:29.757293 2707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:29.758473 2707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:29.768745 2712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:29.768711 2707 server_base.cc:1034] running on GCE node
W20260811 07:31:29.768632 2718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:29.768632 2715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:29.769765 2707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:29.771111 2707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:29.772395 2707 hybrid_clock.cc:648] HybridClock initialized: now 1786433489772378 us; error 40 us; skew 500 ppm
Aug 11 07:31:29 dist-test-slave-77v9 krb5kdc[2691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433489, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:29.776041 2707 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:29.777307 2707 webserver.cc:460] Webserver started at http://127.0.0.1:39869/ using document root <none> and password file <none>
I20260811 07:31:29.777946 2707 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:29.778023 2707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:29.778221 2707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:29.780611 2707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "56c110b696024bdf9daa91b35b1080ea"
format_stamp: "Formatted at 2026-08-11 07:31:29 on dist-test-slave-77v9"
server_key: "00cd7eb67a667493127c68b23a023562"
server_key_iv: "212b0eddeb6781c54d2202668c70c849"
server_key_version: "encryptionkey@0"
I20260811 07:31:29.781584 2707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "56c110b696024bdf9daa91b35b1080ea"
format_stamp: "Formatted at 2026-08-11 07:31:29 on dist-test-slave-77v9"
server_key: "00cd7eb67a667493127c68b23a023562"
server_key_iv: "212b0eddeb6781c54d2202668c70c849"
server_key_version: "encryptionkey@0"
I20260811 07:31:29.787050 2707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:31:29.790105 2725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:29.791746 2707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 07:31:29.792016 2707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "56c110b696024bdf9daa91b35b1080ea"
format_stamp: "Formatted at 2026-08-11 07:31:29 on dist-test-slave-77v9"
server_key: "00cd7eb67a667493127c68b23a023562"
server_key_iv: "212b0eddeb6781c54d2202668c70c849"
server_key_version: "encryptionkey@0"
I20260811 07:31:29.792179 2707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:29.815663 2707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:29.819437 2707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:29.819695 2707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:29.828210 2707 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37465
I20260811 07:31:29.828225 2783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37465 every 8 connection(s)
I20260811 07:31:29.829320 2707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:29.831871 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2707
I20260811 07:31:29.832110 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:29.832502 12256 external_mini_cluster.cc:1428] Setting key 2ae7549c504c5eb93856429810281f48
I20260811 07:31:29.832697 2784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:29.840153 2784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea: Bootstrap starting.
I20260811 07:31:29.842839 2784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea: Neither blocks nor log segments found. Creating new log.
Aug 11 07:31:29 dist-test-slave-77v9 krb5kdc[2691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:31:29.843782 2784 log.cc:824] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:29.847034 2784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea: No bootstrap required, opened a new log
I20260811 07:31:29.850981 2788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:29.834310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47335 (local address 127.0.0.1:37465)
0811 07:31:29.834889 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:29.834908 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:29.834949 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:31:29.835685 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:29.835705 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:29.836114 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:29.836567 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:29.837645 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:29.838821 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:29.839875 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:29.840519 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:29.840734 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:29.844061 (+ 3327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:29.844067 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:29.844085 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:29.844122 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:29.846697 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:29.847539 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:29.847546 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:29.847554 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:29.847720 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:29.848116 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:29.848120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:29.848122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:29.848747 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:29.849045 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:29.849381 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 07:31:29.849672 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":189,"threads_started":1}
I20260811 07:31:29.852499 2784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56c110b696024bdf9daa91b35b1080ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260811 07:31:29.852768 2784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:29.852900 2784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c110b696024bdf9daa91b35b1080ea, State: Initialized, Role: FOLLOWER
I20260811 07:31:29.853487 2784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56c110b696024bdf9daa91b35b1080ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260811 07:31:29.853680 2784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:29.853785 2784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:29.853909 2784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:29.854964 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:29.855402 2784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56c110b696024bdf9daa91b35b1080ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260811 07:31:29.855837 2784 leader_election.cc:302] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56c110b696024bdf9daa91b35b1080ea; no voters:
I20260811 07:31:29.856233 2784 leader_election.cc:288] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:29.856398 2791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:29.856755 2791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [term 1 LEADER]: Becoming Leader. State: Replica: 56c110b696024bdf9daa91b35b1080ea, State: Running, Role: LEADER
I20260811 07:31:29.857183 2791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56c110b696024bdf9daa91b35b1080ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } }
I20260811 07:31:29.857957 2784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:29.859211 2797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56c110b696024bdf9daa91b35b1080ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56c110b696024bdf9daa91b35b1080ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } } }
I20260811 07:31:29.859407 2797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:29.859869 2793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56c110b696024bdf9daa91b35b1080ea. Latest consensus state: current_term: 1 leader_uuid: "56c110b696024bdf9daa91b35b1080ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56c110b696024bdf9daa91b35b1080ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37465 } } }
I20260811 07:31:29.859992 2793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:29.860356 2807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:29.864408 2807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:29.872067 2807 catalog_manager.cc:1347] Generated new cluster ID: 575479662ada49ef8e805bb1f20f1ddf
I20260811 07:31:29.872169 2807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:29.872541 2788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:29.857815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45259 (local address 127.0.0.1:37465)
0811 07:31:29.857969 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:29.857978 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:29.858670 (+ 692us) server_negotiation.cc:407] Connection header received
0811 07:31:29.858928 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:29.858934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:29.859007 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:29.859081 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:29.860354 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:29.861245 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:29.862635 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:29.863054 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:29.863195 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:29.865375 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:29.865379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:29.865383 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:29.865418 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:29.869606 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:29.870400 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:29.870404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:29.870407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:29.870527 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:29.870979 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:29.870983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:29.870985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:29.871256 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:29.871438 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:29.872258 (+ 820us) server_negotiation.cc:299] Negotiation successful
0811 07:31:29.872372 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:31:29.886269 2807 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:29.887737 2807 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:29.903836 2807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56c110b696024bdf9daa91b35b1080ea: Generated new TSK 0
I20260811 07:31:29.904996 2807 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:29.913300 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2707
W20260811 07:31:29.924260 2689 connection.cc:535] client connection to 127.0.0.1:37465 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37465): Connection reset by peer (error 104)
2026-08-11T07:31:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1589 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:29 dist-test-slave-77v9 krb5kdc[2821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:29 dist-test-slave-77v9 krb5kdc[2821](info): set up 2 sockets
Aug 11 07:31:29 dist-test-slave-77v9 krb5kdc[2821](info): commencing operation
krb5kdc: starting...
W20260811 07:31:31.084340 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:31 dist-test-slave-77v9 krb5kdc[2821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:31.233376 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42277
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:31.355432 2834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:31.355747 2834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:31.355796 2834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:31.359946 2834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:31.360037 2834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:31.360059 2834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:31.360075 2834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:31.360091 2834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:31.365845 2834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42277
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:31.366994 2834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:31.368036 2834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:31.377820 2840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:31.377919 2843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:31.377923 2841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:31.378362 2834 server_base.cc:1034] running on GCE node
I20260811 07:31:31.379187 2834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:31.380513 2834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:31.381865 2834 hybrid_clock.cc:648] HybridClock initialized: now 1786433491381838 us; error 172 us; skew 500 ppm
Aug 11 07:31:31 dist-test-slave-77v9 krb5kdc[2821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:31.385334 2834 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:31.386313 2834 webserver.cc:460] Webserver started at http://127.0.0.1:40397/ using document root <none> and password file <none>
I20260811 07:31:31.386901 2834 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:31.386970 2834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:31.387156 2834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:31.389529 2834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "0703cbe79fae447d8486a88ddc3d6884"
format_stamp: "Formatted at 2026-08-11 07:31:31 on dist-test-slave-77v9"
server_key: "608c372a98f1f0c278fe3e5d987b4a35"
server_key_iv: "32d33e152a94ee232bcc0245e03a7692"
server_key_version: "encryptionkey@0"
I20260811 07:31:31.390131 2834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "0703cbe79fae447d8486a88ddc3d6884"
format_stamp: "Formatted at 2026-08-11 07:31:31 on dist-test-slave-77v9"
server_key: "608c372a98f1f0c278fe3e5d987b4a35"
server_key_iv: "32d33e152a94ee232bcc0245e03a7692"
server_key_version: "encryptionkey@0"
I20260811 07:31:31.394622 2834 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:31.397534 2851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:31.399156 2834 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:31.399363 2834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "0703cbe79fae447d8486a88ddc3d6884"
format_stamp: "Formatted at 2026-08-11 07:31:31 on dist-test-slave-77v9"
server_key: "608c372a98f1f0c278fe3e5d987b4a35"
server_key_iv: "32d33e152a94ee232bcc0245e03a7692"
server_key_version: "encryptionkey@0"
I20260811 07:31:31.399518 2834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:31.415247 2834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:31.419389 2834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:31.419656 2834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:31.429239 2834 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42277
I20260811 07:31:31.429374 2908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42277 every 8 connection(s)
I20260811 07:31:31.430464 2834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:31.432614 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2834
I20260811 07:31:31.432888 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:31.433372 12256 external_mini_cluster.cc:1428] Setting key 4aa61d00b2dbdae852d41477b251601f
I20260811 07:31:31.435918 2909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:31.443753 2909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884: Bootstrap starting.
I20260811 07:31:31.444974 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:31.435020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48589 (local address 127.0.0.1:42277)
0811 07:31:31.435590 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:31.435613 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:31.435660 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:31:31.436435 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:31.436455 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:31.436933 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:31.437403 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:31.438380 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:31.439462 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:31.440962 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:31.441505 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:31.441643 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:31.442855 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:31.442860 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:31.442875 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:31.443334 (+ 459us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:31.443403 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:31.443428 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:31.443549 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:31.443796 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 07:31:31.444117 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":172,"threads_started":1}
I20260811 07:31:31.446501 2909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:31.447459 2909 log.cc:824] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:31.448472 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:31.450454 2909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884: No bootstrap required, opened a new log
I20260811 07:31:31.455506 2909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0703cbe79fae447d8486a88ddc3d6884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42277 } }
I20260811 07:31:31.455902 2909 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:31.455981 2909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0703cbe79fae447d8486a88ddc3d6884, State: Initialized, Role: FOLLOWER
I20260811 07:31:31.456166 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:31.451251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50665 (local address 127.0.0.1:42277)
0811 07:31:31.451398 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:31.451403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:31.451630 (+ 227us) server_negotiation.cc:407] Connection header received
0811 07:31:31.451717 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:31.451720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:31.451768 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:31.451879 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:31.452159 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:31.453110 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:31.454091 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:31.454454 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:31.454572 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:31.455541 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:31.455546 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:31.455552 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:31.455571 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:31.455604 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:31.455618 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:31.455716 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:31.455837 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 07:31:31.455882 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:31:31.456512 2909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0703cbe79fae447d8486a88ddc3d6884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42277 } }
I20260811 07:31:31.456701 2909 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:31.456775 2909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:31.456914 2909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:31.458077 2909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0703cbe79fae447d8486a88ddc3d6884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42277 } }
I20260811 07:31:31.458571 2909 leader_election.cc:302] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0703cbe79fae447d8486a88ddc3d6884; no voters:
I20260811 07:31:31.459002 2909 leader_election.cc:288] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:31.459174 2919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:31.459426 2919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [term 1 LEADER]: Becoming Leader. State: Replica: 0703cbe79fae447d8486a88ddc3d6884, State: Running, Role: LEADER
I20260811 07:31:31.459812 2919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0703cbe79fae447d8486a88ddc3d6884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42277 } }
I20260811 07:31:31.460450 2909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:31.461819 2920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0703cbe79fae447d8486a88ddc3d6884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0703cbe79fae447d8486a88ddc3d6884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42277 } } }
I20260811 07:31:31.462005 2920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:31.462476 2929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:31.461819 2921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0703cbe79fae447d8486a88ddc3d6884. Latest consensus state: current_term: 1 leader_uuid: "0703cbe79fae447d8486a88ddc3d6884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0703cbe79fae447d8486a88ddc3d6884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42277 } } }
I20260811 07:31:31.462852 2921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:31.465801 2929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:31.472550 2929 catalog_manager.cc:1347] Generated new cluster ID: c5a3d5c5c474438587bb2a0a53cd892e
I20260811 07:31:31.472636 2929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:31.495637 2929 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:31.497097 2929 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:31.515939 2929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0703cbe79fae447d8486a88ddc3d6884: Generated new TSK 0
I20260811 07:31:31.517055 2929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:31.522710 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2834
W20260811 07:31:31.531385 2819 connection.cc:535] client connection to 127.0.0.1:42277 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42277): Connection reset by peer (error 104)
2026-08-11T07:31:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:31 dist-test-slave-77v9 krb5kdc[2942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:31 dist-test-slave-77v9 krb5kdc[2942](info): set up 2 sockets
Aug 11 07:31:31 dist-test-slave-77v9 krb5kdc[2942](info): commencing operation
krb5kdc: starting...
W20260811 07:31:32.664939 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:32 dist-test-slave-77v9 krb5kdc[2942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:32.820399 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35917
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:32.943101 2955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:32.943429 2955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:32.943475 2955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:32.947883 2955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:32.947974 2955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:32.947996 2955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:32.948014 2955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:32.948031 2955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:32.953964 2955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:32.955487 2955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:32.956575 2955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:32.965875 2964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:32.965900 2960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:32.966251 2955 server_base.cc:1034] running on GCE node
W20260811 07:31:32.966324 2962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:32.967119 2955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:32.968397 2955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:32.969596 2955 hybrid_clock.cc:648] HybridClock initialized: now 1786433492969568 us; error 43 us; skew 500 ppm
Aug 11 07:31:32 dist-test-slave-77v9 krb5kdc[2942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433492, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:32.976939 2955 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:32.978048 2955 webserver.cc:460] Webserver started at http://127.0.0.1:44425/ using document root <none> and password file <none>
I20260811 07:31:32.978672 2955 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:32.978775 2955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:32.979028 2955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:32.981438 2955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "6c2c61bb77014efd9b57d255ffc5ec54"
format_stamp: "Formatted at 2026-08-11 07:31:32 on dist-test-slave-77v9"
server_key: "502c20382b33a637df7ba52a8ebd557a"
server_key_iv: "6ae22031039f13aa8ab1130ba53a4bcb"
server_key_version: "encryptionkey@0"
I20260811 07:31:32.982093 2955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "6c2c61bb77014efd9b57d255ffc5ec54"
format_stamp: "Formatted at 2026-08-11 07:31:32 on dist-test-slave-77v9"
server_key: "502c20382b33a637df7ba52a8ebd557a"
server_key_iv: "6ae22031039f13aa8ab1130ba53a4bcb"
server_key_version: "encryptionkey@0"
I20260811 07:31:32.986328 2955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:32.989133 2972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:32.990667 2955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:32.990914 2955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "6c2c61bb77014efd9b57d255ffc5ec54"
format_stamp: "Formatted at 2026-08-11 07:31:32 on dist-test-slave-77v9"
server_key: "502c20382b33a637df7ba52a8ebd557a"
server_key_iv: "6ae22031039f13aa8ab1130ba53a4bcb"
server_key_version: "encryptionkey@0"
I20260811 07:31:32.991067 2955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:32.996491 2955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:33.000546 2955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:33.000895 2955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:33.009506 2955 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35917
I20260811 07:31:33.009539 3028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35917 every 8 connection(s)
I20260811 07:31:33.010623 2955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:33.013820 3029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:33.019472 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 2955
I20260811 07:31:33.019685 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:33.020026 12256 external_mini_cluster.cc:1428] Setting key 7a060a1201198c1df5518f00a4977f50
I20260811 07:31:33.020251 3029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54: Bootstrap starting.
I20260811 07:31:33.023157 3029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:33.024063 3029 log.cc:824] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:33.025967 3032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:33.021584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57155 (local address 127.0.0.1:35917)
0811 07:31:33.022207 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:33.022224 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:33.022265 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:31:33.022985 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:33.023004 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:33.023345 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:33.023726 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:33.024566 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:33.024571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:33.024583 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:33.024594 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:33.024651 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:33.024670 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:33.024801 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:33.024946 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 07:31:33.025239 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":165,"threads_started":1}
I20260811 07:31:33.026302 3029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54: No bootstrap required, opened a new log
I20260811 07:31:33.029088 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:33.030200 3029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35917 } }
I20260811 07:31:33.030516 3029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:33.030587 3029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c2c61bb77014efd9b57d255ffc5ec54, State: Initialized, Role: FOLLOWER
I20260811 07:31:33.031060 3029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35917 } }
I20260811 07:31:33.031252 3029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:33.031354 3029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:33.031643 3029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:33.032956 3029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35917 } }
I20260811 07:31:33.033448 3032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:33.031469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45141 (local address 127.0.0.1:35917)
0811 07:31:33.031636 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:33.031641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:33.031896 (+ 255us) server_negotiation.cc:407] Connection header received
0811 07:31:33.032052 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:33.032055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:33.032092 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:33.032184 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:33.033029 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:33.033033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:33.033035 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:33.033047 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:33.033076 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:33.033089 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:33.033175 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:33.033283 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 07:31:33.033317 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:31:33.033399 3029 leader_election.cc:302] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c2c61bb77014efd9b57d255ffc5ec54; no voters:
I20260811 07:31:33.034086 3029 leader_election.cc:288] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:33.034157 3040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:33.034406 3040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [term 1 LEADER]: Becoming Leader. State: Replica: 6c2c61bb77014efd9b57d255ffc5ec54, State: Running, Role: LEADER
I20260811 07:31:33.034758 3040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35917 } }
I20260811 07:31:33.035904 3029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:33.036760 3042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c2c61bb77014efd9b57d255ffc5ec54. Latest consensus state: current_term: 1 leader_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35917 } } }
I20260811 07:31:33.036760 3041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2c61bb77014efd9b57d255ffc5ec54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35917 } } }
I20260811 07:31:33.036969 3041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:33.036969 3042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:33.037489 3050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:33.041586 3050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:33.048153 3050 catalog_manager.cc:1347] Generated new cluster ID: a7d3dec2f14246179f77e560ecdc2983
I20260811 07:31:33.048269 3050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:33.057919 3050 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:33.058326 3050 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:33.066501 3050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c2c61bb77014efd9b57d255ffc5ec54: Generated new TSK 0
I20260811 07:31:33.067404 3050 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:33.073055 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 2955
2026-08-11T07:31:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1550 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:33 dist-test-slave-77v9 krb5kdc[3062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:33 dist-test-slave-77v9 krb5kdc[3062](info): set up 2 sockets
Aug 11 07:31:33 dist-test-slave-77v9 krb5kdc[3062](info): commencing operation
krb5kdc: starting...
W20260811 07:31:34.242174 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:34 dist-test-slave-77v9 krb5kdc[3062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:34.405988 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40597
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:34.528431 3078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:34.528767 3078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:34.528913 3078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:34.533157 3078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:34.533244 3078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:34.533265 3078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:34.533283 3078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:34.533299 3078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:34.539279 3078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:34.540469 3078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:34.541522 3078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:34.551137 3085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:34.551162 3083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:34.551307 3078 server_base.cc:1034] running on GCE node
W20260811 07:31:34.551615 3087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:34.552284 3078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:34.553598 3078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:34.554807 3078 hybrid_clock.cc:648] HybridClock initialized: now 1786433494554770 us; error 47 us; skew 500 ppm
Aug 11 07:31:34 dist-test-slave-77v9 krb5kdc[3062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433494, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:34.558579 3078 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:34.559727 3078 webserver.cc:460] Webserver started at http://127.0.0.1:35313/ using document root <none> and password file <none>
I20260811 07:31:34.560402 3078 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:34.560520 3078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:34.560787 3078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:34.563241 3078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "b27e442d0cc74488a81a0ba8fee3471b"
format_stamp: "Formatted at 2026-08-11 07:31:34 on dist-test-slave-77v9"
server_key: "4fb7254cbd83b9a6ba6250e3f4dd3ff7"
server_key_iv: "43774f934ce32886e4f92380bab09999"
server_key_version: "encryptionkey@0"
I20260811 07:31:34.563923 3078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "b27e442d0cc74488a81a0ba8fee3471b"
format_stamp: "Formatted at 2026-08-11 07:31:34 on dist-test-slave-77v9"
server_key: "4fb7254cbd83b9a6ba6250e3f4dd3ff7"
server_key_iv: "43774f934ce32886e4f92380bab09999"
server_key_version: "encryptionkey@0"
I20260811 07:31:34.568564 3078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260811 07:31:34.571699 3095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:34.573522 3078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:34.573719 3078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "b27e442d0cc74488a81a0ba8fee3471b"
format_stamp: "Formatted at 2026-08-11 07:31:34 on dist-test-slave-77v9"
server_key: "4fb7254cbd83b9a6ba6250e3f4dd3ff7"
server_key_iv: "43774f934ce32886e4f92380bab09999"
server_key_version: "encryptionkey@0"
I20260811 07:31:34.573870 3078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:34.594290 3078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:34.598372 3078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:34.598642 3078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:34.607254 3078 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40597
I20260811 07:31:34.607285 3157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40597 every 8 connection(s)
I20260811 07:31:34.608374 3078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:34.611548 3158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:34.615365 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3078
I20260811 07:31:34.615566 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:34.615950 12256 external_mini_cluster.cc:1428] Setting key 659d0f6697a9938c90487ac9def715dd
I20260811 07:31:34.618953 3158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b: Bootstrap starting.
I20260811 07:31:34.622112 3158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:34.623250 3158 log.cc:824] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:34.626438 3158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b: No bootstrap required, opened a new log
Aug 11 07:31:34 dist-test-slave-77v9 krb5kdc[3062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:31:34.630694 3158 raft_consensus.cc:348] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27e442d0cc74488a81a0ba8fee3471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40597 } }
I20260811 07:31:34.631002 3158 raft_consensus.cc:374] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:34.631099 3158 raft_consensus.cc:729] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27e442d0cc74488a81a0ba8fee3471b, State: Initialized, Role: FOLLOWER
I20260811 07:31:34.631726 3158 consensus_queue.cc:260] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27e442d0cc74488a81a0ba8fee3471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40597 } }
I20260811 07:31:34.631933 3158 raft_consensus.cc:388] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:34.632040 3158 raft_consensus.cc:482] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:34.632208 3158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:34.633867 3158 raft_consensus.cc:504] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27e442d0cc74488a81a0ba8fee3471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40597 } }
I20260811 07:31:34.634368 3158 leader_election.cc:302] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b27e442d0cc74488a81a0ba8fee3471b; no voters:
I20260811 07:31:34.634829 3158 leader_election.cc:288] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:34.635051 3164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:34.635139 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:34.617692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39405 (local address 127.0.0.1:40597)
0811 07:31:34.618170 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:34.618188 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:34.618226 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:31:34.618902 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:34.618920 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:34.619371 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:34.619684 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:34.620922 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:34.621981 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:34.623455 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:34.624143 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:34.624352 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:34.628256 (+ 3904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:34.628267 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:34.628283 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:34.628323 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:34.631049 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:34.631607 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:34.631614 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:34.631621 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:34.631766 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:34.632147 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:34.632151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:34.632153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:34.632869 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:34.633118 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:34.633423 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 07:31:34.633851 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":174,"threads_started":1}
I20260811 07:31:34.635396 3164 raft_consensus.cc:686] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [term 1 LEADER]: Becoming Leader. State: Replica: b27e442d0cc74488a81a0ba8fee3471b, State: Running, Role: LEADER
I20260811 07:31:34.635917 3164 consensus_queue.cc:237] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27e442d0cc74488a81a0ba8fee3471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40597 } }
I20260811 07:31:34.636418 3158 sys_catalog.cc:564] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:34.638453 3165 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b27e442d0cc74488a81a0ba8fee3471b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27e442d0cc74488a81a0ba8fee3471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40597 } } }
I20260811 07:31:34.638618 3165 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:34.639550 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:34.639685 3166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b27e442d0cc74488a81a0ba8fee3471b. Latest consensus state: current_term: 1 leader_uuid: "b27e442d0cc74488a81a0ba8fee3471b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27e442d0cc74488a81a0ba8fee3471b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40597 } } }
I20260811 07:31:34.639807 3166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b [sys.catalog]: This master's current role is: LEADER
W20260811 07:31:34.643399 3180 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:34.643515 3180 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:34.643596 3179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:34.644618 3179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:34.653556 3179 catalog_manager.cc:1347] Generated new cluster ID: d6ef848a3c0f41f8a7f0227f57a371a7
I20260811 07:31:34.653653 3179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:34.654461 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:34.642233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49063 (local address 127.0.0.1:40597)
0811 07:31:34.642366 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:34.642371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:34.642578 (+ 207us) server_negotiation.cc:407] Connection header received
0811 07:31:34.642761 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:34.642764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:34.642922 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:34.643081 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:34.644068 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:34.644724 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:34.645780 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:34.646128 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:34.646270 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:34.650266 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:34.650271 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:34.650281 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:34.650314 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:34.652243 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:34.652794 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:34.652798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:34.652800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:34.652940 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:34.653293 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:34.653299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:34.653301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:34.653596 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:34.653740 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:34.654126 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 07:31:34.654279 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 07:31:34.667348 3179 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:34.668551 3179 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:34.681255 3179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b27e442d0cc74488a81a0ba8fee3471b: Generated new TSK 0
I20260811 07:31:34.682354 3179 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:34.695180 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3078
2026-08-11T07:31:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1623 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:34 dist-test-slave-77v9 krb5kdc[3192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:34 dist-test-slave-77v9 krb5kdc[3192](info): set up 2 sockets
Aug 11 07:31:34 dist-test-slave-77v9 krb5kdc[3192](info): commencing operation
krb5kdc: starting...
W20260811 07:31:35.828541 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:35 dist-test-slave-77v9 krb5kdc[3192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:35.985977 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43473
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:36.110342 3207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:36.110715 3207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:36.110816 3207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:36.115151 3207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:36.115267 3207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:36.115309 3207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:36.115376 3207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:36.115432 3207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:36.121404 3207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43473
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:36.122668 3207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:36.123802 3207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:36.133808 3213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:36.133808 3216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:36.133808 3212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:36.134117 3207 server_base.cc:1034] running on GCE node
I20260811 07:31:36.134768 3207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:36.136023 3207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:36.137280 3207 hybrid_clock.cc:648] HybridClock initialized: now 1786433496137256 us; error 47 us; skew 500 ppm
Aug 11 07:31:36 dist-test-slave-77v9 krb5kdc[3192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:36.141512 3207 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:36.142699 3207 webserver.cc:460] Webserver started at http://127.0.0.1:46315/ using document root <none> and password file <none>
I20260811 07:31:36.143329 3207 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:36.143406 3207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:36.143602 3207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:36.146080 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "d940fe84d3db4ae387ab31c4597d2b5f"
format_stamp: "Formatted at 2026-08-11 07:31:36 on dist-test-slave-77v9"
server_key: "d12a6e250690a270df3616906dfc0fbf"
server_key_iv: "54b4c535719463c6f1be927396020b40"
server_key_version: "encryptionkey@0"
I20260811 07:31:36.146757 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "d940fe84d3db4ae387ab31c4597d2b5f"
format_stamp: "Formatted at 2026-08-11 07:31:36 on dist-test-slave-77v9"
server_key: "d12a6e250690a270df3616906dfc0fbf"
server_key_iv: "54b4c535719463c6f1be927396020b40"
server_key_version: "encryptionkey@0"
I20260811 07:31:36.151363 3207 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:36.154095 3224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:36.155572 3207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:36.155732 3207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "d940fe84d3db4ae387ab31c4597d2b5f"
format_stamp: "Formatted at 2026-08-11 07:31:36 on dist-test-slave-77v9"
server_key: "d12a6e250690a270df3616906dfc0fbf"
server_key_iv: "54b4c535719463c6f1be927396020b40"
server_key_version: "encryptionkey@0"
I20260811 07:31:36.155864 3207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:36.167709 3207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:36.171315 3207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:36.171591 3207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:36.180984 3207 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43473
I20260811 07:31:36.180971 3284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43473 every 8 connection(s)
I20260811 07:31:36.182195 3207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:36.185581 3286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:36.185832 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3207
I20260811 07:31:36.186009 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:36.186367 12256 external_mini_cluster.cc:1428] Setting key fb00440f2cba885af51c3cba47d62595
I20260811 07:31:36.193972 3286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f: Bootstrap starting.
I20260811 07:31:36.196960 3286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:36.197050 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:36.187972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55203 (local address 127.0.0.1:43473)
0811 07:31:36.188449 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:36.188467 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:36.188507 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:31:36.189409 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:36.189429 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:36.189811 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:36.190127 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:36.190555 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:36.191757 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:36.193245 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:36.193785 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:36.193990 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:36.195034 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:36.195039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:36.195052 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:36.195487 (+ 435us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:36.195551 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:36.195576 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:36.195661 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:36.195847 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:31:36.196143 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":171,"threads_started":1}
I20260811 07:31:36.197819 3286 log.cc:824] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:36.200373 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:36.200421 3286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f: No bootstrap required, opened a new log
I20260811 07:31:36.206043 3286 raft_consensus.cc:348] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43473 } }
I20260811 07:31:36.206496 3286 raft_consensus.cc:374] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:36.206578 3286 raft_consensus.cc:729] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d940fe84d3db4ae387ab31c4597d2b5f, State: Initialized, Role: FOLLOWER
I20260811 07:31:36.207201 3286 consensus_queue.cc:260] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43473 } }
I20260811 07:31:36.207442 3286 raft_consensus.cc:388] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:36.207537 3286 raft_consensus.cc:482] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:36.207674 3286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:36.208005 3289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:36.202970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59787 (local address 127.0.0.1:43473)
0811 07:31:36.203124 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:36.203130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:36.203376 (+ 246us) server_negotiation.cc:407] Connection header received
0811 07:31:36.203511 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:36.203514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:36.203567 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:36.203676 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:36.203943 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:36.204979 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:36.205867 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:36.206242 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:36.206363 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:36.207400 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:36.207404 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:36.207407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:36.207423 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:36.207461 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:36.207480 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:36.207575 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:36.207704 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 07:31:36.207769 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:31:36.209043 3286 raft_consensus.cc:504] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43473 } }
I20260811 07:31:36.209463 3286 leader_election.cc:302] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d940fe84d3db4ae387ab31c4597d2b5f; no voters:
I20260811 07:31:36.209892 3286 leader_election.cc:288] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:36.210052 3298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:36.210309 3298 raft_consensus.cc:686] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [term 1 LEADER]: Becoming Leader. State: Replica: d940fe84d3db4ae387ab31c4597d2b5f, State: Running, Role: LEADER
I20260811 07:31:36.210744 3298 consensus_queue.cc:237] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43473 } }
I20260811 07:31:36.211478 3286 sys_catalog.cc:564] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:36.212764 3300 sys_catalog.cc:455] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d940fe84d3db4ae387ab31c4597d2b5f. Latest consensus state: current_term: 1 leader_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43473 } } }
I20260811 07:31:36.212843 3299 sys_catalog.cc:455] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d940fe84d3db4ae387ab31c4597d2b5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43473 } } }
I20260811 07:31:36.212950 3300 sys_catalog.cc:458] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:36.212985 3299 sys_catalog.cc:458] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:36.213382 3307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:36.216614 3307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:36.224059 3307 catalog_manager.cc:1347] Generated new cluster ID: 2b35f369f94a4db9ae546b13ab78fea5
I20260811 07:31:36.224176 3307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:36.266806 3307 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:36.267916 3307 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:36.278141 3307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d940fe84d3db4ae387ab31c4597d2b5f: Generated new TSK 0
I20260811 07:31:36.279227 3307 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:36.294454 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3207
2026-08-11T07:31:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1599 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:36 dist-test-slave-77v9 krb5kdc[3321](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:36 dist-test-slave-77v9 krb5kdc[3321](info): set up 2 sockets
Aug 11 07:31:36 dist-test-slave-77v9 krb5kdc[3321](info): commencing operation
krb5kdc: starting...
W20260811 07:31:37.468024 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:37 dist-test-slave-77v9 krb5kdc[3321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:37.625554 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40063
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:37.747452 3335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:37.747844 3335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:37.747941 3335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:37.752246 3335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:37.752390 3335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:37.752430 3335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:37.752471 3335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:37.752529 3335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:37.758450 3335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:37.759763 3335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:37.760946 3335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:37.770290 3341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:37.770290 3343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:37.770316 3340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:37.770599 3335 server_base.cc:1034] running on GCE node
I20260811 07:31:37.771454 3335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:37.772750 3335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:37.774071 3335 hybrid_clock.cc:648] HybridClock initialized: now 1786433497774041 us; error 50 us; skew 500 ppm
Aug 11 07:31:37 dist-test-slave-77v9 krb5kdc[3321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433497, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:37.777587 3335 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:37.778709 3335 webserver.cc:460] Webserver started at http://127.0.0.1:40929/ using document root <none> and password file <none>
I20260811 07:31:37.779336 3335 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:37.779441 3335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:37.779691 3335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:37.782053 3335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "c2c5ada1139c401390c54bf3029ed5f3"
format_stamp: "Formatted at 2026-08-11 07:31:37 on dist-test-slave-77v9"
server_key: "a59a900466d2493095674926fdc374b2"
server_key_iv: "5751e7926221f9d3066434681448dbcf"
server_key_version: "encryptionkey@0"
I20260811 07:31:37.782691 3335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "c2c5ada1139c401390c54bf3029ed5f3"
format_stamp: "Formatted at 2026-08-11 07:31:37 on dist-test-slave-77v9"
server_key: "a59a900466d2493095674926fdc374b2"
server_key_iv: "5751e7926221f9d3066434681448dbcf"
server_key_version: "encryptionkey@0"
I20260811 07:31:37.787166 3335 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:37.790406 3352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:37.792037 3335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:31:37.792235 3335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "c2c5ada1139c401390c54bf3029ed5f3"
format_stamp: "Formatted at 2026-08-11 07:31:37 on dist-test-slave-77v9"
server_key: "a59a900466d2493095674926fdc374b2"
server_key_iv: "5751e7926221f9d3066434681448dbcf"
server_key_version: "encryptionkey@0"
I20260811 07:31:37.792385 3335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:37.797715 3335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:37.801533 3335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:37.801784 3335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:37.809856 3335 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40063
I20260811 07:31:37.809895 3413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40063 every 8 connection(s)
I20260811 07:31:37.810915 3335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:37.814469 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3335
I20260811 07:31:37.814602 3414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:37.814649 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:37.814997 12256 external_mini_cluster.cc:1428] Setting key 8fb0ba2e4cf8631abf4d630cd7e95e98
I20260811 07:31:37.821211 3417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:37.816590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46283 (local address 127.0.0.1:40063)
0811 07:31:37.817240 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:37.817258 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:37.817306 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:31:37.818089 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:37.818111 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:37.818529 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:37.818995 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:37.819844 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:37.819850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:37.819862 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:37.819873 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:37.819931 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:37.819951 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:37.820123 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:37.820198 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 07:31:37.820367 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":284,"threads_started":1}
I20260811 07:31:37.822600 3414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3: Bootstrap starting.
I20260811 07:31:37.824448 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:37.825320 3414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:37.826298 3414 log.cc:824] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:37.828491 3414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3: No bootstrap required, opened a new log
I20260811 07:31:37.830696 3417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:37.827057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36003 (local address 127.0.0.1:40063)
0811 07:31:37.827201 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:37.827206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:37.828893 (+ 1687us) server_negotiation.cc:407] Connection header received
0811 07:31:37.829100 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:37.829103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:37.829142 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:37.829224 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:37.830220 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:37.830224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:37.830226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:37.830239 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:37.830271 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:37.830285 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:37.830383 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:37.830476 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 07:31:37.830513 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:31:37.832993 3414 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5ada1139c401390c54bf3029ed5f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:31:37.833282 3414 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:37.833377 3414 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c5ada1139c401390c54bf3029ed5f3, State: Initialized, Role: FOLLOWER
I20260811 07:31:37.833832 3414 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5ada1139c401390c54bf3029ed5f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:31:37.833987 3414 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:37.834074 3414 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:37.834197 3414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:37.835278 3414 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5ada1139c401390c54bf3029ed5f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:31:37.835646 3414 leader_election.cc:302] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2c5ada1139c401390c54bf3029ed5f3; no voters:
I20260811 07:31:37.836014 3414 leader_election.cc:288] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:37.836261 3425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:37.836591 3425 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [term 1 LEADER]: Becoming Leader. State: Replica: c2c5ada1139c401390c54bf3029ed5f3, State: Running, Role: LEADER
I20260811 07:31:37.837037 3425 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5ada1139c401390c54bf3029ed5f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } }
I20260811 07:31:37.837646 3414 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:37.839084 3428 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2c5ada1139c401390c54bf3029ed5f3. Latest consensus state: current_term: 1 leader_uuid: "c2c5ada1139c401390c54bf3029ed5f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5ada1139c401390c54bf3029ed5f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } } }
I20260811 07:31:37.839124 3426 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2c5ada1139c401390c54bf3029ed5f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2c5ada1139c401390c54bf3029ed5f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40063 } } }
I20260811 07:31:37.839316 3428 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:37.839341 3426 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3 [sys.catalog]: This master's current role is: LEADER
W20260811 07:31:37.843011 3443 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:37.843148 3443 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:37.843240 3439 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:37.843964 3439 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:37.850366 3439 catalog_manager.cc:1347] Generated new cluster ID: 5154974fa0c04aedb738d81bb9c408f3
I20260811 07:31:37.850476 3439 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:37.870337 3439 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:37.870792 3439 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:37.877668 3439 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2c5ada1139c401390c54bf3029ed5f3: Generated new TSK 0
I20260811 07:31:37.878633 3439 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:37.893570 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3335
2026-08-11T07:31:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1598 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:37 dist-test-slave-77v9 krb5kdc[3450](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:37 dist-test-slave-77v9 krb5kdc[3450](info): set up 2 sockets
Aug 11 07:31:37 dist-test-slave-77v9 krb5kdc[3450](info): commencing operation
krb5kdc: starting...
W20260811 07:31:39.046936 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:39 dist-test-slave-77v9 krb5kdc[3450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:39.196698 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41443
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:39.317615 3466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:39.317960 3466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:39.318007 3466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:39.323279 3466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:39.323371 3466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:39.323395 3466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:39.323413 3466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:39.323431 3466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:39.329268 3466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:39.330533 3466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:39.331560 3466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:39.341282 3472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:39.341243 3474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:39.341476 3466 server_base.cc:1034] running on GCE node
W20260811 07:31:39.341679 3471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:39.342338 3466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:39.343652 3466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:39.344890 3466 hybrid_clock.cc:648] HybridClock initialized: now 1786433499344861 us; error 36 us; skew 500 ppm
Aug 11 07:31:39 dist-test-slave-77v9 krb5kdc[3450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433499, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:39.354023 3466 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:39.355221 3466 webserver.cc:460] Webserver started at http://127.0.0.1:39867/ using document root <none> and password file <none>
I20260811 07:31:39.355852 3466 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:39.355923 3466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:39.356109 3466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:39.358633 3466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "9c377e453d0349939f5210feb4629f2a"
format_stamp: "Formatted at 2026-08-11 07:31:39 on dist-test-slave-77v9"
server_key: "5ea02e96a2c974e24aeac4c5fcf863fd"
server_key_iv: "d071ea4aa350c001a812e1891c018390"
server_key_version: "encryptionkey@0"
I20260811 07:31:39.359437 3466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "9c377e453d0349939f5210feb4629f2a"
format_stamp: "Formatted at 2026-08-11 07:31:39 on dist-test-slave-77v9"
server_key: "5ea02e96a2c974e24aeac4c5fcf863fd"
server_key_iv: "d071ea4aa350c001a812e1891c018390"
server_key_version: "encryptionkey@0"
I20260811 07:31:39.363760 3466 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:31:39.367048 3481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:39.368939 3466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 07:31:39.369112 3466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "9c377e453d0349939f5210feb4629f2a"
format_stamp: "Formatted at 2026-08-11 07:31:39 on dist-test-slave-77v9"
server_key: "5ea02e96a2c974e24aeac4c5fcf863fd"
server_key_iv: "d071ea4aa350c001a812e1891c018390"
server_key_version: "encryptionkey@0"
I20260811 07:31:39.369261 3466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:39.384238 3466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:39.388557 3466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:39.388819 3466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:39.397241 3466 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41443
I20260811 07:31:39.397256 3541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41443 every 8 connection(s)
I20260811 07:31:39.398360 3466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:39.401573 3542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:39.405576 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3466
I20260811 07:31:39.405764 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:39.406086 12256 external_mini_cluster.cc:1428] Setting key 748a04bc88e35ec860c0eeefd6d249d7
I20260811 07:31:39.408653 3542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a: Bootstrap starting.
I20260811 07:31:39.411095 3542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:39.411924 3542 log.cc:824] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:39.414117 3542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a: No bootstrap required, opened a new log
Aug 11 07:31:39 dist-test-slave-77v9 krb5kdc[3450](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:31:39.418467 3542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c377e453d0349939f5210feb4629f2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41443 } }
I20260811 07:31:39.418777 3542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:39.418864 3542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c377e453d0349939f5210feb4629f2a, State: Initialized, Role: FOLLOWER
I20260811 07:31:39.419344 3542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c377e453d0349939f5210feb4629f2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41443 } }
I20260811 07:31:39.419515 3542 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:39.419605 3542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:39.419729 3542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:39.420791 3542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c377e453d0349939f5210feb4629f2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41443 } }
I20260811 07:31:39.421232 3542 leader_election.cc:302] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c377e453d0349939f5210feb4629f2a; no voters:
I20260811 07:31:39.421625 3542 leader_election.cc:288] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:39.421715 3547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:39.421988 3547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [term 1 LEADER]: Becoming Leader. State: Replica: 9c377e453d0349939f5210feb4629f2a, State: Running, Role: LEADER
I20260811 07:31:39.422355 3547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c377e453d0349939f5210feb4629f2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41443 } }
I20260811 07:31:39.423097 3542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:39.423102 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:39.407935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:55931 (local address 127.0.0.1:41443)
0811 07:31:39.408508 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:39.408525 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:39.408566 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:31:39.409405 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:39.409424 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:39.409796 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:39.410163 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:39.411113 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:39.412280 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:39.413291 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:39.413788 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:39.413973 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:39.417113 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:39.417119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:39.417137 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:39.417172 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:39.419502 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:39.420176 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:39.420193 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:39.420197 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:39.420326 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:39.420691 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:39.420695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:39.420696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:39.421287 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:39.421534 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:39.421912 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:31:39.422177 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":170,"threads_started":1}
I20260811 07:31:39.424043 3549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c377e453d0349939f5210feb4629f2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c377e453d0349939f5210feb4629f2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41443 } } }
I20260811 07:31:39.424218 3549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:39.425678 3548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c377e453d0349939f5210feb4629f2a. Latest consensus state: current_term: 1 leader_uuid: "9c377e453d0349939f5210feb4629f2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c377e453d0349939f5210feb4629f2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41443 } } }
I20260811 07:31:39.426438 3548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:39.429319 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 07:31:39.429437 3563 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:39.429539 3563 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:39.431921 3553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:39.433212 3553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:39.440537 3553 catalog_manager.cc:1347] Generated new cluster ID: 903d56b9cc524df19abb595b01e8b9fa
I20260811 07:31:39.440632 3553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:39.443239 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:39.432654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:60559 (local address 127.0.0.1:41443)
0811 07:31:39.432771 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:39.432777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:39.432797 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:31:39.432890 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:39.432893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:39.432947 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:39.433046 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:39.433994 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:39.434794 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:39.436286 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:39.436679 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:39.436852 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:39.438645 (+ 1793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:39.438649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:39.438652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:39.438689 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:39.440719 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:39.441589 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:39.441593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:39.441595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:39.441712 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:39.442132 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:39.442137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:39.442139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:39.442412 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:39.442578 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:39.442890 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 07:31:39.443019 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:31:39.459966 3553 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:39.461192 3553 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:39.469621 3553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c377e453d0349939f5210feb4629f2a: Generated new TSK 0
I20260811 07:31:39.470448 3553 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:39.483683 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3466
W20260811 07:31:39.492208 3447 connection.cc:535] client connection to 127.0.0.1:41443 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41443): Connection reset by peer (error 104)
2026-08-11T07:31:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1589 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:39 dist-test-slave-77v9 krb5kdc[3575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:39 dist-test-slave-77v9 krb5kdc[3575](info): set up 2 sockets
Aug 11 07:31:39 dist-test-slave-77v9 krb5kdc[3575](info): commencing operation
krb5kdc: starting...
W20260811 07:31:40.644482 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:40 dist-test-slave-77v9 krb5kdc[3575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:40.798108 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44891
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:40.921797 3590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:40.922235 3590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:40.922326 3590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:40.927196 3590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:40.927364 3590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:40.927405 3590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:40.927459 3590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:40.927521 3590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:40.933854 3590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:40.935206 3590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:40.936406 3590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:40.946280 3597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:40.946586 3590 server_base.cc:1034] running on GCE node
W20260811 07:31:40.946307 3596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:40.946311 3600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:40.947366 3590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:40.948714 3590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:40.949929 3590 hybrid_clock.cc:648] HybridClock initialized: now 1786433500949912 us; error 38 us; skew 500 ppm
Aug 11 07:31:40 dist-test-slave-77v9 krb5kdc[3575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433500, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:40.954062 3590 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:40.955334 3590 webserver.cc:460] Webserver started at http://127.0.0.1:44345/ using document root <none> and password file <none>
I20260811 07:31:40.956038 3590 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:40.956149 3590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:40.956419 3590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:40.959093 3590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "b87c4280ec3a446cab93775f84795612"
format_stamp: "Formatted at 2026-08-11 07:31:40 on dist-test-slave-77v9"
server_key: "179f02e68f4c93830120402432aa6892"
server_key_iv: "a06390eef9d4146bd97f99aed727eb9d"
server_key_version: "encryptionkey@0"
I20260811 07:31:40.959877 3590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "b87c4280ec3a446cab93775f84795612"
format_stamp: "Formatted at 2026-08-11 07:31:40 on dist-test-slave-77v9"
server_key: "179f02e68f4c93830120402432aa6892"
server_key_iv: "a06390eef9d4146bd97f99aed727eb9d"
server_key_version: "encryptionkey@0"
I20260811 07:31:40.964978 3590 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:31:40.968254 3609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:40.970237 3590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:40.970479 3590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "b87c4280ec3a446cab93775f84795612"
format_stamp: "Formatted at 2026-08-11 07:31:40 on dist-test-slave-77v9"
server_key: "179f02e68f4c93830120402432aa6892"
server_key_iv: "a06390eef9d4146bd97f99aed727eb9d"
server_key_version: "encryptionkey@0"
I20260811 07:31:40.970660 3590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:40.990722 3590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:40.995256 3590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:40.995539 3590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:41.004112 3590 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44891
I20260811 07:31:41.004130 3669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44891 every 8 connection(s)
I20260811 07:31:41.005285 3590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:41.007812 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3590
I20260811 07:31:41.007995 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:41.008332 12256 external_mini_cluster.cc:1428] Setting key 3db528cca566b9a92b0a6a0e188042b8
I20260811 07:31:41.008780 3670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:41.016389 3670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612: Bootstrap starting.
I20260811 07:31:41.019151 3670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:41.019239 3674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:41.010083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:47951 (local address 127.0.0.1:44891)
0811 07:31:41.010678 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:41.010696 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:41.010747 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:31:41.011942 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:41.011968 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:41.012405 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:41.012835 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:41.013346 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:41.014415 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:41.015491 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:41.016050 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:41.016246 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:41.017364 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:41.017370 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:41.017385 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:41.017815 (+ 430us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:41.017888 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:41.017915 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:41.018070 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:41.018281 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 07:31:41.018448 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":193,"threads_started":1}
I20260811 07:31:41.020228 3670 log.cc:824] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:41.022841 3670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612: No bootstrap required, opened a new log
I20260811 07:31:41.023203 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:41.027302 3670 raft_consensus.cc:348] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c4280ec3a446cab93775f84795612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260811 07:31:41.027593 3670 raft_consensus.cc:374] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:41.027634 3670 raft_consensus.cc:729] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4280ec3a446cab93775f84795612, State: Initialized, Role: FOLLOWER
I20260811 07:31:41.028122 3670 consensus_queue.cc:260] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c4280ec3a446cab93775f84795612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260811 07:31:41.028303 3670 raft_consensus.cc:388] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:41.028383 3670 raft_consensus.cc:482] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:41.028499 3670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:41.029858 3670 raft_consensus.cc:504] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c4280ec3a446cab93775f84795612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260811 07:31:41.030400 3670 leader_election.cc:302] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b87c4280ec3a446cab93775f84795612; no voters:
I20260811 07:31:41.030797 3670 leader_election.cc:288] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:41.030985 3682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:41.031294 3682 raft_consensus.cc:686] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [term 1 LEADER]: Becoming Leader. State: Replica: b87c4280ec3a446cab93775f84795612, State: Running, Role: LEADER
I20260811 07:31:41.031680 3682 consensus_queue.cc:237] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c4280ec3a446cab93775f84795612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260811 07:31:41.032480 3670 sys_catalog.cc:564] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:41.033569 3674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:41.025633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:37741 (local address 127.0.0.1:44891)
0811 07:31:41.025771 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:41.025776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:41.028104 (+ 2328us) server_negotiation.cc:407] Connection header received
0811 07:31:41.028307 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:41.028311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:41.028412 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:41.028509 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:41.029134 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:41.029728 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:41.031010 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:41.031361 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:41.031480 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:41.032728 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:41.032732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:41.032735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:41.032751 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:41.032783 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:41.032795 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:41.032913 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:41.033320 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 07:31:41.033380 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:31:41.033733 3684 sys_catalog.cc:455] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b87c4280ec3a446cab93775f84795612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c4280ec3a446cab93775f84795612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } } }
I20260811 07:31:41.033895 3684 sys_catalog.cc:458] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:41.034391 3695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:41.034405 3685 sys_catalog.cc:455] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b87c4280ec3a446cab93775f84795612. Latest consensus state: current_term: 1 leader_uuid: "b87c4280ec3a446cab93775f84795612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b87c4280ec3a446cab93775f84795612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } } }
I20260811 07:31:41.034584 3685 sys_catalog.cc:458] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:41.038057 3695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:41.046896 3695 catalog_manager.cc:1347] Generated new cluster ID: 7382c3e2364e47e5a54d3af19df84d85
I20260811 07:31:41.047014 3695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:41.062700 3695 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:41.064167 3695 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:41.080015 3695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b87c4280ec3a446cab93775f84795612: Generated new TSK 0
I20260811 07:31:41.081077 3695 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:41.093719 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3590
W20260811 07:31:41.104305 3573 connection.cc:535] client connection to 127.0.0.1:44891 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44891): Connection reset by peer (error 104)
2026-08-11T07:31:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:41 dist-test-slave-77v9 krb5kdc[3710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:41 dist-test-slave-77v9 krb5kdc[3710](info): set up 2 sockets
Aug 11 07:31:41 dist-test-slave-77v9 krb5kdc[3710](info): commencing operation
krb5kdc: starting...
W20260811 07:31:42.273213 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:42 dist-test-slave-77v9 krb5kdc[3710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:42.429167 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43119
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:42.551996 3724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:42.552393 3724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:42.552481 3724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:42.557003 3724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:42.557160 3724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:42.557202 3724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:42.557240 3724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:42.557268 3724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:42.563589 3724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:42.564939 3724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:42.566082 3724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:42.575906 3729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:42.575995 3732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:42.576051 3724 server_base.cc:1034] running on GCE node
W20260811 07:31:42.576328 3730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:42.577133 3724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:42.578606 3724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:42.579824 3724 hybrid_clock.cc:648] HybridClock initialized: now 1786433502579790 us; error 49 us; skew 500 ppm
Aug 11 07:31:42 dist-test-slave-77v9 krb5kdc[3710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433502, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:42.583586 3724 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:42.584731 3724 webserver.cc:460] Webserver started at http://127.0.0.1:38391/ using document root <none> and password file <none>
I20260811 07:31:42.585451 3724 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:42.585528 3724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:42.585829 3724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:42.588301 3724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "917023c424b54d42b68f422f604c010e"
format_stamp: "Formatted at 2026-08-11 07:31:42 on dist-test-slave-77v9"
server_key: "af4b1dba64b78d1baaaad6119ab2c67e"
server_key_iv: "a3f416ae940344f4094e5050e6420c21"
server_key_version: "encryptionkey@0"
I20260811 07:31:42.589116 3724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "917023c424b54d42b68f422f604c010e"
format_stamp: "Formatted at 2026-08-11 07:31:42 on dist-test-slave-77v9"
server_key: "af4b1dba64b78d1baaaad6119ab2c67e"
server_key_iv: "a3f416ae940344f4094e5050e6420c21"
server_key_version: "encryptionkey@0"
I20260811 07:31:42.593894 3724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:42.597170 3741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:42.598788 3724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:42.598991 3724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "917023c424b54d42b68f422f604c010e"
format_stamp: "Formatted at 2026-08-11 07:31:42 on dist-test-slave-77v9"
server_key: "af4b1dba64b78d1baaaad6119ab2c67e"
server_key_iv: "a3f416ae940344f4094e5050e6420c21"
server_key_version: "encryptionkey@0"
I20260811 07:31:42.599159 3724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:42.604679 3724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:42.608923 3724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:42.609162 3724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:42.617318 3724 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43119
I20260811 07:31:42.617499 3807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43119 every 8 connection(s)
I20260811 07:31:42.618563 3724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:42.621908 3808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:42.628243 3808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e: Bootstrap starting.
I20260811 07:31:42.628720 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3724
I20260811 07:31:42.628917 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:42.629281 12256 external_mini_cluster.cc:1428] Setting key 856137904e9da7318080fc3bb098ec54
I20260811 07:31:42.631633 3808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:42.632525 3808 log.cc:824] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:42.635031 3808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e: No bootstrap required, opened a new log
I20260811 07:31:42.636016 3812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:42.630973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:47841 (local address 127.0.0.1:43119)
0811 07:31:42.631578 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:42.631595 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:42.631639 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:31:42.632630 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:42.632660 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:42.633136 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:42.633546 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:42.634538 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:42.634543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:42.634558 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:42.634569 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:42.634630 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:42.634652 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:42.634814 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:42.634907 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 07:31:42.635134 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":179,"threads_started":1}
I20260811 07:31:42.639339 3808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "917023c424b54d42b68f422f604c010e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260811 07:31:42.639706 3808 raft_consensus.cc:374] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:42.639710 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:42.639782 3808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 917023c424b54d42b68f422f604c010e, State: Initialized, Role: FOLLOWER
I20260811 07:31:42.640236 3808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "917023c424b54d42b68f422f604c010e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260811 07:31:42.640374 3808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:42.640487 3808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:42.640628 3808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:42.642009 3808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "917023c424b54d42b68f422f604c010e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260811 07:31:42.642454 3808 leader_election.cc:302] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 917023c424b54d42b68f422f604c010e; no voters:
I20260811 07:31:42.642941 3808 leader_election.cc:288] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:42.643061 3820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:42.643311 3820 raft_consensus.cc:686] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [term 1 LEADER]: Becoming Leader. State: Replica: 917023c424b54d42b68f422f604c010e, State: Running, Role: LEADER
I20260811 07:31:42.643798 3820 consensus_queue.cc:237] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "917023c424b54d42b68f422f604c010e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } }
I20260811 07:31:42.644671 3808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:42.645334 3820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 917023c424b54d42b68f422f604c010e. Latest consensus state: current_term: 1 leader_uuid: "917023c424b54d42b68f422f604c010e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "917023c424b54d42b68f422f604c010e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } } }
I20260811 07:31:42.645495 3820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:42.645848 3812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:42.642466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:56877 (local address 127.0.0.1:43119)
0811 07:31:42.642628 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:42.642634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:42.643397 (+ 763us) server_negotiation.cc:407] Connection header received
0811 07:31:42.643454 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:42.643457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:42.643501 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:42.643573 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:42.644710 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:42.644714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:42.644716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:42.644730 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:42.644762 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:42.644775 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:42.644897 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:42.645271 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 07:31:42.645328 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:31:42.646060 3826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:42.647258 3821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "917023c424b54d42b68f422f604c010e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "917023c424b54d42b68f422f604c010e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43119 } } }
I20260811 07:31:42.647361 3821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:42.649927 3826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:42.657107 3826 catalog_manager.cc:1347] Generated new cluster ID: 0e88556fc6c84c1a9aa8b2cfc1688956
I20260811 07:31:42.657238 3826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:42.690498 3826 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:42.691056 3826 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:42.696256 3826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 917023c424b54d42b68f422f604c010e: Generated new TSK 0
I20260811 07:31:42.697170 3826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:42.704084 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3724
2026-08-11T07:31:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:42 dist-test-slave-77v9 krb5kdc[3842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:42 dist-test-slave-77v9 krb5kdc[3842](info): set up 2 sockets
Aug 11 07:31:42 dist-test-slave-77v9 krb5kdc[3842](info): commencing operation
krb5kdc: starting...
W20260811 07:31:43.857303 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:43 dist-test-slave-77v9 krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:44.009270 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44733
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:44.135005 3857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:44.135380 3857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:44.135466 3857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:44.139750 3857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:44.139881 3857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:44.139917 3857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:44.139948 3857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:44.139998 3857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:44.145954 3857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44733
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:44.147245 3857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:44.148398 3857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:44.158123 3866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:44.158123 3863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:44.158217 3862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:44.158393 3857 server_base.cc:1034] running on GCE node
I20260811 07:31:44.159214 3857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:44.160483 3857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:44.161659 3857 hybrid_clock.cc:648] HybridClock initialized: now 1786433504161610 us; error 67 us; skew 500 ppm
Aug 11 07:31:44 dist-test-slave-77v9 krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433504, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:44.164851 3857 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:44.165915 3857 webserver.cc:460] Webserver started at http://127.0.0.1:35085/ using document root <none> and password file <none>
I20260811 07:31:44.166558 3857 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:44.166661 3857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:44.166910 3857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:44.169299 3857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "2340edcfccc047958db9f5c3f7cf70f6"
format_stamp: "Formatted at 2026-08-11 07:31:44 on dist-test-slave-77v9"
server_key: "bced79fcc8e250eeffcd3eb1819bfa77"
server_key_iv: "de3d56941b41714150716de157072874"
server_key_version: "encryptionkey@0"
I20260811 07:31:44.169973 3857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "2340edcfccc047958db9f5c3f7cf70f6"
format_stamp: "Formatted at 2026-08-11 07:31:44 on dist-test-slave-77v9"
server_key: "bced79fcc8e250eeffcd3eb1819bfa77"
server_key_iv: "de3d56941b41714150716de157072874"
server_key_version: "encryptionkey@0"
I20260811 07:31:44.174324 3857 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 07:31:44.177629 3876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:44.179282 3857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:44.179472 3857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "2340edcfccc047958db9f5c3f7cf70f6"
format_stamp: "Formatted at 2026-08-11 07:31:44 on dist-test-slave-77v9"
server_key: "bced79fcc8e250eeffcd3eb1819bfa77"
server_key_iv: "de3d56941b41714150716de157072874"
server_key_version: "encryptionkey@0"
I20260811 07:31:44.179625 3857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:44.202461 3857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:44.206156 3857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:44.206415 3857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:44.215096 3857 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44733
I20260811 07:31:44.215143 3933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44733 every 8 connection(s)
I20260811 07:31:44.216372 3857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:44.218663 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3857
I20260811 07:31:44.218792 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:44.219156 12256 external_mini_cluster.cc:1428] Setting key 96c753d6e2c87ac4d5e7149babb1d05d
I20260811 07:31:44.220443 3934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:44.228614 3934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6: Bootstrap starting.
Aug 11 07:31:44 dist-test-slave-77v9 krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:31:44.231841 3934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:44.233011 3934 log.cc:824] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:44.235873 3934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6: No bootstrap required, opened a new log
I20260811 07:31:44.238083 3937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:44.220788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:52403 (local address 127.0.0.1:44733)
0811 07:31:44.221388 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:44.221412 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:44.221462 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:31:44.222457 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:44.222484 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:44.223014 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:44.223455 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:44.224342 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:44.226070 (+ 1728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:44.227070 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:44.227878 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:44.228056 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:44.231231 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:44.231238 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:44.231258 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:44.231300 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:44.233725 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:44.234430 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:44.234438 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:44.234445 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:44.234602 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:44.235029 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:44.235033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:44.235035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:44.235614 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:44.235857 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:44.236622 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 07:31:44.236974 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":191,"threads_started":1}
I20260811 07:31:44.239789 3934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2340edcfccc047958db9f5c3f7cf70f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44733 } }
I20260811 07:31:44.240125 3934 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:44.240190 3934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2340edcfccc047958db9f5c3f7cf70f6, State: Initialized, Role: FOLLOWER
I20260811 07:31:44.240711 3934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2340edcfccc047958db9f5c3f7cf70f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44733 } }
I20260811 07:31:44.240918 3934 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:44.241012 3934 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:44.241150 3934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:44.241992 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:44.242460 3934 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2340edcfccc047958db9f5c3f7cf70f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44733 } }
I20260811 07:31:44.242875 3934 leader_election.cc:302] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2340edcfccc047958db9f5c3f7cf70f6; no voters:
I20260811 07:31:44.243297 3934 leader_election.cc:288] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:44.243391 3939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:44.243711 3939 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [term 1 LEADER]: Becoming Leader. State: Replica: 2340edcfccc047958db9f5c3f7cf70f6, State: Running, Role: LEADER
I20260811 07:31:44.244122 3939 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2340edcfccc047958db9f5c3f7cf70f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44733 } }
I20260811 07:31:44.244953 3934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:44.245625 3939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2340edcfccc047958db9f5c3f7cf70f6. Latest consensus state: current_term: 1 leader_uuid: "2340edcfccc047958db9f5c3f7cf70f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2340edcfccc047958db9f5c3f7cf70f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44733 } } }
I20260811 07:31:44.245767 3939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:44.246117 3945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2340edcfccc047958db9f5c3f7cf70f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2340edcfccc047958db9f5c3f7cf70f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44733 } } }
I20260811 07:31:44.246230 3945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6 [sys.catalog]: This master's current role is: LEADER
W20260811 07:31:44.250706 3963 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:44.250823 3963 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:44.250906 3952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:44.251889 3952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:44.255995 3937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:44.244613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:47847 (local address 127.0.0.1:44733)
0811 07:31:44.244755 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:44.244761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:44.245398 (+ 637us) server_negotiation.cc:407] Connection header received
0811 07:31:44.245619 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:44.245625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:44.245686 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:44.245775 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:44.246908 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:44.247749 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:44.248739 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:44.249146 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:44.250371 (+ 1225us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:44.251434 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:44.251439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:44.251442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:44.251471 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:44.253580 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:44.254279 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:44.254283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:44.254285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:44.254382 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:44.254917 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:44.254920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:44.254922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:44.255166 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:44.255319 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:44.255704 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 07:31:44.255819 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:31:44.258880 3952 catalog_manager.cc:1347] Generated new cluster ID: 9dde08582d694d7b84e5ad384dd81308
I20260811 07:31:44.258975 3952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:44.295451 3952 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:44.296721 3952 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:44.304399 3952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2340edcfccc047958db9f5c3f7cf70f6: Generated new TSK 0
I20260811 07:31:44.305372 3952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:44.322283 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3857
W20260811 07:31:44.331413 3839 connection.cc:535] client connection to 127.0.0.1:44733 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44733): Connection reset by peer (error 104)
2026-08-11T07:31:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:44 dist-test-slave-77v9 krb5kdc[3971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:44 dist-test-slave-77v9 krb5kdc[3971](info): set up 2 sockets
Aug 11 07:31:44 dist-test-slave-77v9 krb5kdc[3971](info): commencing operation
krb5kdc: starting...
W20260811 07:31:45.509140 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:45 dist-test-slave-77v9 krb5kdc[3971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:45.666289 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38311
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:45.786217 3986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:45.786566 3986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:45.786612 3986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:45.791594 3986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:45.791700 3986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:45.791723 3986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:45.791740 3986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:45.791756 3986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:45.797792 3986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38311
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:45.798992 3986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:45.800055 3986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:45.809350 3992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:45.809459 3986 server_base.cc:1034] running on GCE node
W20260811 07:31:45.809360 3994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:45.809377 3997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:45.810374 3986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:45.811654 3986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:45.812914 3986 hybrid_clock.cc:648] HybridClock initialized: now 1786433505812898 us; error 55 us; skew 500 ppm
Aug 11 07:31:45 dist-test-slave-77v9 krb5kdc[3971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433505, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:45.816622 3986 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:45.817915 3986 webserver.cc:460] Webserver started at http://127.0.0.1:44135/ using document root <none> and password file <none>
I20260811 07:31:45.818616 3986 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:45.818740 3986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:45.819015 3986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:45.821594 3986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b"
format_stamp: "Formatted at 2026-08-11 07:31:45 on dist-test-slave-77v9"
server_key: "080f5662e117c01cea6dd66003d05800"
server_key_iv: "c4a49a38334664544d068c2aa0c1636e"
server_key_version: "encryptionkey@0"
I20260811 07:31:45.822330 3986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b"
format_stamp: "Formatted at 2026-08-11 07:31:45 on dist-test-slave-77v9"
server_key: "080f5662e117c01cea6dd66003d05800"
server_key_iv: "c4a49a38334664544d068c2aa0c1636e"
server_key_version: "encryptionkey@0"
I20260811 07:31:45.827091 3986 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 07:31:45.830359 4005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:45.831998 3986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:31:45.832206 3986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b"
format_stamp: "Formatted at 2026-08-11 07:31:45 on dist-test-slave-77v9"
server_key: "080f5662e117c01cea6dd66003d05800"
server_key_iv: "c4a49a38334664544d068c2aa0c1636e"
server_key_version: "encryptionkey@0"
I20260811 07:31:45.832370 3986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:45.854833 3986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:45.858850 3986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:45.859128 3986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:45.867990 3986 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38311
I20260811 07:31:45.868016 4063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38311 every 8 connection(s)
I20260811 07:31:45.869221 3986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:45.872233 4064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:45.875510 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 3986
I20260811 07:31:45.875710 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:45.876044 12256 external_mini_cluster.cc:1428] Setting key 22257c48cb3dea36c047fc4a29fa722a
I20260811 07:31:45.878698 4064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b: Bootstrap starting.
I20260811 07:31:45.881372 4064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:45.882402 4064 log.cc:824] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:45.884865 4064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b: No bootstrap required, opened a new log
I20260811 07:31:45.886405 4067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:45.877668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:35479 (local address 127.0.0.1:38311)
0811 07:31:45.878142 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:45.878159 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:45.878200 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:31:45.878983 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:45.879003 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:45.879426 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:45.879739 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:45.880205 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:45.881456 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:45.882770 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:45.883323 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:45.883457 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:45.884418 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:45.884424 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:45.884438 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:45.884936 (+ 498us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:45.885023 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:45.885051 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:45.885164 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:45.885370 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 07:31:45.885542 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":157,"threads_started":1}
I20260811 07:31:45.889145 4064 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38311 } }
I20260811 07:31:45.889437 4064 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:45.889501 4064 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f11f95cfb043d8ab3ed05b5ec32f3b, State: Initialized, Role: FOLLOWER
I20260811 07:31:45.889992 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:45.889957 4064 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38311 } }
I20260811 07:31:45.890121 4064 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:45.890187 4064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:45.890282 4064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:45.891677 4064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38311 } }
I20260811 07:31:45.892071 4064 leader_election.cc:302] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77f11f95cfb043d8ab3ed05b5ec32f3b; no voters:
I20260811 07:31:45.892518 4064 leader_election.cc:288] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:45.892669 4076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:45.892917 4076 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [term 1 LEADER]: Becoming Leader. State: Replica: 77f11f95cfb043d8ab3ed05b5ec32f3b, State: Running, Role: LEADER
I20260811 07:31:45.893251 4076 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38311 } }
I20260811 07:31:45.893954 4064 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:45.894503 4076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77f11f95cfb043d8ab3ed05b5ec32f3b. Latest consensus state: current_term: 1 leader_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38311 } } }
I20260811 07:31:45.894626 4076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:45.895350 4079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f11f95cfb043d8ab3ed05b5ec32f3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38311 } } }
I20260811 07:31:45.895453 4079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:45.895744 4083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:45.898072 4067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:45.892470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:60951 (local address 127.0.0.1:38311)
0811 07:31:45.892614 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:45.892619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:45.892948 (+ 329us) server_negotiation.cc:407] Connection header received
0811 07:31:45.893172 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:45.893175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:45.893226 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:45.893328 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:45.893784 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:45.894507 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:45.895839 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:45.896211 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:45.896318 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:45.897528 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:45.897532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:45.897535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:45.897550 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:45.897583 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:45.897594 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:45.897702 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:45.897870 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 07:31:45.897910 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:31:45.899394 4083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:45.905118 4083 catalog_manager.cc:1347] Generated new cluster ID: 10a60ad30abc4270aba7dced71fa84bb
I20260811 07:31:45.905215 4083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:45.928773 4083 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:45.930277 4083 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:45.939904 4083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77f11f95cfb043d8ab3ed05b5ec32f3b: Generated new TSK 0
I20260811 07:31:45.941009 4083 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:45.953666 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 3986
W20260811 07:31:45.963647 3968 connection.cc:535] client connection to 127.0.0.1:38311 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38311): Connection reset by peer (error 104)
2026-08-11T07:31:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:46 dist-test-slave-77v9 krb5kdc[4103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:46 dist-test-slave-77v9 krb5kdc[4103](info): set up 2 sockets
Aug 11 07:31:46 dist-test-slave-77v9 krb5kdc[4103](info): commencing operation
krb5kdc: starting...
W20260811 07:31:47.107384 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:47 dist-test-slave-77v9 krb5kdc[4103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:31:47.260511 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40513
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:47.387951 4125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:47.388302 4125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:47.388402 4125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:47.393010 4125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:47.393124 4125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:47.393146 4125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:47.393163 4125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:47.393187 4125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:47.399094 4125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40513
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:47.400437 4125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:47.401643 4125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:47.411559 4133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:47.411535 4130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:47.411542 4131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:47.411640 4125 server_base.cc:1034] running on GCE node
I20260811 07:31:47.412504 4125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:47.413828 4125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:47.415040 4125 hybrid_clock.cc:648] HybridClock initialized: now 1786433507415009 us; error 48 us; skew 500 ppm
Aug 11 07:31:47 dist-test-slave-77v9 krb5kdc[4103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:47.418525 4125 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:31:47.419724 4125 webserver.cc:460] Webserver started at http://127.0.0.1:39471/ using document root <none> and password file <none>
I20260811 07:31:47.420375 4125 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:47.420450 4125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:47.420646 4125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:47.423190 4125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "2e0b66b100e1428db11e1db02780b6a8"
format_stamp: "Formatted at 2026-08-11 07:31:47 on dist-test-slave-77v9"
server_key: "893f18ff6433f7570d8e4c432e9bf187"
server_key_iv: "60ae14aa531d4bd583053bd90def3474"
server_key_version: "encryptionkey@0"
I20260811 07:31:47.423836 4125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "2e0b66b100e1428db11e1db02780b6a8"
format_stamp: "Formatted at 2026-08-11 07:31:47 on dist-test-slave-77v9"
server_key: "893f18ff6433f7570d8e4c432e9bf187"
server_key_iv: "60ae14aa531d4bd583053bd90def3474"
server_key_version: "encryptionkey@0"
I20260811 07:31:47.429081 4125 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:31:47.433219 4140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:47.435259 4125 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:31:47.435550 4125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "2e0b66b100e1428db11e1db02780b6a8"
format_stamp: "Formatted at 2026-08-11 07:31:47 on dist-test-slave-77v9"
server_key: "893f18ff6433f7570d8e4c432e9bf187"
server_key_iv: "60ae14aa531d4bd583053bd90def3474"
server_key_version: "encryptionkey@0"
I20260811 07:31:47.435752 4125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:47.441746 4125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:47.445823 4125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:47.446031 4125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:47.455201 4125 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40513
I20260811 07:31:47.455224 4196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40513 every 8 connection(s)
I20260811 07:31:47.456318 4125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:47.459821 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4125
I20260811 07:31:47.460018 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:47.460253 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:47.460410 12256 external_mini_cluster.cc:1428] Setting key a31532d54e19dd7d27a4666904b1dbad
I20260811 07:31:47.466797 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:47.462253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:60853 (local address 127.0.0.1:40513)
0811 07:31:47.462807 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:47.462829 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:47.462881 (+ 52us) server_negotiation.cc:407] Connection header received
0811 07:31:47.463609 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:47.463640 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:47.463975 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:47.464418 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:47.465392 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:47.465399 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:47.465419 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:47.465430 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:47.465491 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:47.465514 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:47.465695 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:47.465774 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:31:47.465962 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":202,"threads_started":1}
I20260811 07:31:47.468485 4197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8: Bootstrap starting.
I20260811 07:31:47.470394 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:47.471454 4197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:47.472404 4197 log.cc:824] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:47.474956 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:47.473004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.120:36001 (local address 127.0.0.1:40513)
0811 07:31:47.473167 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:47.473173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:47.473380 (+ 207us) server_negotiation.cc:407] Connection header received
0811 07:31:47.473574 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:47.473578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:47.473625 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:47.473735 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:47.474546 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:47.474550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:47.474553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:47.474567 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:47.474599 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:47.474614 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:47.474720 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:47.474777 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 07:31:47.474823 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:31:47.475452 4197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8: No bootstrap required, opened a new log
I20260811 07:31:47.479859 4197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0b66b100e1428db11e1db02780b6a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40513 } }
I20260811 07:31:47.480160 4197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:47.480230 4197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e0b66b100e1428db11e1db02780b6a8, State: Initialized, Role: FOLLOWER
I20260811 07:31:47.480723 4197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0b66b100e1428db11e1db02780b6a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40513 } }
I20260811 07:31:47.480942 4197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:47.481050 4197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:47.481184 4197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:47.482559 4197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0b66b100e1428db11e1db02780b6a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40513 } }
I20260811 07:31:47.482966 4197 leader_election.cc:302] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e0b66b100e1428db11e1db02780b6a8; no voters:
I20260811 07:31:47.483336 4197 leader_election.cc:288] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:47.483534 4209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:47.483922 4209 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [term 1 LEADER]: Becoming Leader. State: Replica: 2e0b66b100e1428db11e1db02780b6a8, State: Running, Role: LEADER
I20260811 07:31:47.484259 4209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0b66b100e1428db11e1db02780b6a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40513 } }
I20260811 07:31:47.484789 4197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:47.486362 4211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e0b66b100e1428db11e1db02780b6a8. Latest consensus state: current_term: 1 leader_uuid: "2e0b66b100e1428db11e1db02780b6a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0b66b100e1428db11e1db02780b6a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40513 } } }
I20260811 07:31:47.486390 4210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e0b66b100e1428db11e1db02780b6a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e0b66b100e1428db11e1db02780b6a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40513 } } }
I20260811 07:31:47.486563 4211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:47.486567 4210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:47.486977 4221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:47.491130 4221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:47.498610 4221 catalog_manager.cc:1347] Generated new cluster ID: de81b792109c401991b4d298134bc0c9
I20260811 07:31:47.498833 4221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:47.513032 4221 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:47.513427 4221 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:47.523183 4221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e0b66b100e1428db11e1db02780b6a8: Generated new TSK 0
I20260811 07:31:47.524080 4221 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:47.531347 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4125
2026-08-11T07:31:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1577 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:47 dist-test-slave-77v9 krb5kdc[4232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:47 dist-test-slave-77v9 krb5kdc[4232](info): set up 2 sockets
Aug 11 07:31:47 dist-test-slave-77v9 krb5kdc[4232](info): commencing operation
krb5kdc: starting...
W20260811 07:31:48.680217 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:48 dist-test-slave-77v9 krb5kdc[4232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:48.845502 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42923
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:38097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:42923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:48.968178 4245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:48.968538 4245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:48.968585 4245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:48.972941 4245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:48.973037 4245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:48.973106 4245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:48.973135 4245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:48.973156 4245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:48.978982 4245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:38097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:42923
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:42923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:48.980195 4245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:48.981326 4245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:48.991206 4251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:48.991194 4252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:48.991194 4254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:48.991534 4245 server_base.cc:1034] running on GCE node
I20260811 07:31:48.992280 4245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:48.993723 4245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:48.994910 4245 hybrid_clock.cc:648] HybridClock initialized: now 1786433508994895 us; error 34 us; skew 500 ppm
Aug 11 07:31:48 dist-test-slave-77v9 krb5kdc[4232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433508, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:48.998296 4245 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:48.999469 4245 webserver.cc:460] Webserver started at http://127.11.248.62:45401/ using document root <none> and password file <none>
I20260811 07:31:49.000114 4245 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:49.000200 4245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:49.000475 4245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:49.003206 4245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "c7b57fe456d54ed08221100b9fc65c5c"
format_stamp: "Formatted at 2026-08-11 07:31:48 on dist-test-slave-77v9"
server_key: "f6369fc3cbe5a41b0cf529d2e42674a7"
server_key_iv: "aec96a40151e63cd5b95c5dbe9d65e26"
server_key_version: "encryptionkey@0"
I20260811 07:31:49.003974 4245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "c7b57fe456d54ed08221100b9fc65c5c"
format_stamp: "Formatted at 2026-08-11 07:31:48 on dist-test-slave-77v9"
server_key: "f6369fc3cbe5a41b0cf529d2e42674a7"
server_key_iv: "aec96a40151e63cd5b95c5dbe9d65e26"
server_key_version: "encryptionkey@0"
I20260811 07:31:49.008651 4245 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:31:49.011909 4261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:49.013715 4245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:49.013877 4245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "c7b57fe456d54ed08221100b9fc65c5c"
format_stamp: "Formatted at 2026-08-11 07:31:48 on dist-test-slave-77v9"
server_key: "f6369fc3cbe5a41b0cf529d2e42674a7"
server_key_iv: "aec96a40151e63cd5b95c5dbe9d65e26"
server_key_version: "encryptionkey@0"
I20260811 07:31:49.014092 4245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:49.036032 4245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:49.040356 4245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:49.040640 4245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:49.049285 4245 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:42923
I20260811 07:31:49.049329 4319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:42923 every 8 connection(s)
I20260811 07:31:49.050444 4245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:49.054399 4320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:49.054955 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4245
I20260811 07:31:49.055148 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:49.055464 12256 external_mini_cluster.cc:1428] Setting key dc1cb5e9e1cf8e3126df03f8ce0c5e8d
I20260811 07:31:49.061746 4320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c: Bootstrap starting.
I20260811 07:31:49.064940 4320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:49.066013 4320 log.cc:824] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:31:49 dist-test-slave-77v9 krb5kdc[4232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:49.069084 4320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c: No bootstrap required, opened a new log
I20260811 07:31:49.073671 4323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:49.057099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58707 (local address 127.11.248.62:42923)
0811 07:31:49.057725 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:49.057742 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:49.057784 (+ 42us) server_negotiation.cc:407] Connection header received
0811 07:31:49.058610 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:49.058630 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:49.059041 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:49.059393 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:49.060482 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:49.061738 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:49.063014 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:49.063536 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:49.063674 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:49.067192 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:49.067199 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:49.067220 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:49.067252 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:49.069493 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:49.070268 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:49.070275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:49.070281 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:49.070446 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:49.070906 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:49.070910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:49.070911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:49.071598 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:49.071824 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:49.072205 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 07:31:49.072479 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":181,"threads_started":1}
I20260811 07:31:49.074126 4320 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b57fe456d54ed08221100b9fc65c5c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42923 } }
I20260811 07:31:49.074455 4320 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:49.074520 4320 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7b57fe456d54ed08221100b9fc65c5c, State: Initialized, Role: FOLLOWER
I20260811 07:31:49.074995 4320 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b57fe456d54ed08221100b9fc65c5c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42923 } }
I20260811 07:31:49.075138 4320 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:49.075249 4320 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:49.075371 4320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:49.076690 4320 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b57fe456d54ed08221100b9fc65c5c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42923 } }
I20260811 07:31:49.077091 4320 leader_election.cc:302] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7b57fe456d54ed08221100b9fc65c5c; no voters:
I20260811 07:31:49.077457 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:49.077517 4320 leader_election.cc:288] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:49.077651 4326 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:49.077996 4326 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [term 1 LEADER]: Becoming Leader. State: Replica: c7b57fe456d54ed08221100b9fc65c5c, State: Running, Role: LEADER
I20260811 07:31:49.078358 4326 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b57fe456d54ed08221100b9fc65c5c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42923 } }
I20260811 07:31:49.078909 4320 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:49.079918 4326 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7b57fe456d54ed08221100b9fc65c5c. Latest consensus state: current_term: 1 leader_uuid: "c7b57fe456d54ed08221100b9fc65c5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b57fe456d54ed08221100b9fc65c5c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42923 } } }
I20260811 07:31:49.080071 4326 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:49.080364 4327 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7b57fe456d54ed08221100b9fc65c5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b57fe456d54ed08221100b9fc65c5c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 42923 } } }
I20260811 07:31:49.080466 4327 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:49.080474 4340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:49.084406 4340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:49.091066 4323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:49.080069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35733 (local address 127.11.248.62:42923)
0811 07:31:49.080215 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:49.080222 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:49.081482 (+ 1260us) server_negotiation.cc:407] Connection header received
0811 07:31:49.081699 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:49.081703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:49.081770 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:49.081867 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:49.082760 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:49.083537 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:49.084844 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:49.085147 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:49.085281 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:49.086867 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:49.086871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:49.086874 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:49.086908 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:49.088797 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:49.089513 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:49.089516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:49.089518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:49.089617 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:49.089994 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:49.089998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:49.090000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:49.090275 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:49.090442 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:49.090784 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 07:31:49.090900 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:31:49.091964 4340 catalog_manager.cc:1347] Generated new cluster ID: 71fb52aeece942519c54929d2a225772
I20260811 07:31:49.092072 4340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:49.131141 4340 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:49.132681 4340 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:49.145115 4340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7b57fe456d54ed08221100b9fc65c5c: Generated new TSK 0
I20260811 07:31:49.146011 4340 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:49.157354 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4245
W20260811 07:31:49.166100 4230 connection.cc:535] client connection to 127.11.248.62:42923 recv error: Network error: failed to read from TLS socket (remote: 127.11.248.62:42923): Connection reset by peer (error 104)
2026-08-11T07:31:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1625 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:49 dist-test-slave-77v9 krb5kdc[4355](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:49 dist-test-slave-77v9 krb5kdc[4355](info): set up 2 sockets
Aug 11 07:31:49 dist-test-slave-77v9 krb5kdc[4355](info): commencing operation
krb5kdc: starting...
W20260811 07:31:50.281152 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:50 dist-test-slave-77v9 krb5kdc[4355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:50.437624 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46657
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:46657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:50.560959 4370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:50.561287 4370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:50.561364 4370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:50.565907 4370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:50.565994 4370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:50.566015 4370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:50.566032 4370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:50.566049 4370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:50.571930 4370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:46657
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:46657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:50.573238 4370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:50.574370 4370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:50.584393 4377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:50.584501 4370 server_base.cc:1034] running on GCE node
W20260811 07:31:50.584527 4380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:50.584610 4378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:50.585580 4370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:50.586957 4370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:50.588192 4370 hybrid_clock.cc:648] HybridClock initialized: now 1786433510588136 us; error 75 us; skew 500 ppm
Aug 11 07:31:50 dist-test-slave-77v9 krb5kdc[4355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433510, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:50.595774 4370 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:50.597295 4370 webserver.cc:460] Webserver started at http://127.11.248.62:35515/ using document root <none> and password file <none>
I20260811 07:31:50.597946 4370 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:50.598022 4370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:50.598214 4370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:50.600528 4370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef"
format_stamp: "Formatted at 2026-08-11 07:31:50 on dist-test-slave-77v9"
server_key: "59bb61a58a9c727fc7b6aeec45f014cf"
server_key_iv: "127afa70c2144aaef4085941ba9d6f65"
server_key_version: "encryptionkey@0"
I20260811 07:31:50.601231 4370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef"
format_stamp: "Formatted at 2026-08-11 07:31:50 on dist-test-slave-77v9"
server_key: "59bb61a58a9c727fc7b6aeec45f014cf"
server_key_iv: "127afa70c2144aaef4085941ba9d6f65"
server_key_version: "encryptionkey@0"
I20260811 07:31:50.605566 4370 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:31:50.609077 4387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:50.610595 4370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:50.610764 4370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef"
format_stamp: "Formatted at 2026-08-11 07:31:50 on dist-test-slave-77v9"
server_key: "59bb61a58a9c727fc7b6aeec45f014cf"
server_key_iv: "127afa70c2144aaef4085941ba9d6f65"
server_key_version: "encryptionkey@0"
I20260811 07:31:50.610910 4370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:50.621268 4370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:50.625285 4370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:50.625545 4370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:50.633893 4370 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:46657
I20260811 07:31:50.633906 4452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:46657 every 8 connection(s)
I20260811 07:31:50.635046 4370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:50.636971 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4370
I20260811 07:31:50.637145 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:50.637497 12256 external_mini_cluster.cc:1428] Setting key 73914b8fa0b65855ed9c84c66fda3ee5
I20260811 07:31:50.638855 4454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:50.645339 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef: Bootstrap starting.
I20260811 07:31:50.648258 4454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:50.648577 4457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:50.639213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58539 (local address 127.11.248.62:46657)
0811 07:31:50.639770 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:50.639787 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:50.639831 (+ 44us) server_negotiation.cc:407] Connection header received
0811 07:31:50.640646 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:50.640666 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:50.641170 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:50.641583 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:50.642076 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:50.643233 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:50.644338 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:50.645013 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:50.645210 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:50.646545 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:50.646551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:50.646565 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:50.647008 (+ 443us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:50.647079 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:50.647105 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:50.647271 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:50.647496 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 07:31:50.647656 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":181,"threads_started":1}
I20260811 07:31:50.649415 4454 log.cc:824] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:50.652061 4454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef: No bootstrap required, opened a new log
I20260811 07:31:50.652694 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:50.656849 4454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46657 } }
I20260811 07:31:50.657226 4454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:50.657291 4454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d8d21e03b544dd83d3c44fd2e5d4ef, State: Initialized, Role: FOLLOWER
I20260811 07:31:50.657806 4454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46657 } }
I20260811 07:31:50.657950 4454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:50.658025 4454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:50.658149 4454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:50.659759 4454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46657 } }
I20260811 07:31:50.660176 4457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:50.654983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54781 (local address 127.11.248.62:46657)
0811 07:31:50.655132 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:50.655136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:50.655271 (+ 135us) server_negotiation.cc:407] Connection header received
0811 07:31:50.655411 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:50.655413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:50.655465 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:50.655537 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:50.655942 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:50.656501 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:50.657704 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:50.658160 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:50.658317 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:50.659476 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:50.659479 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:50.659482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:50.659497 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:50.659528 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:50.659541 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:50.659632 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:50.660005 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 07:31:50.660054 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:31:50.660220 4454 leader_election.cc:302] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05d8d21e03b544dd83d3c44fd2e5d4ef; no voters:
I20260811 07:31:50.660622 4454 leader_election.cc:288] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:50.660928 4467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:50.661203 4467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [term 1 LEADER]: Becoming Leader. State: Replica: 05d8d21e03b544dd83d3c44fd2e5d4ef, State: Running, Role: LEADER
I20260811 07:31:50.661628 4467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46657 } }
I20260811 07:31:50.662215 4454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:50.662932 4467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05d8d21e03b544dd83d3c44fd2e5d4ef. Latest consensus state: current_term: 1 leader_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46657 } } }
I20260811 07:31:50.663149 4467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:50.663434 4469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05d8d21e03b544dd83d3c44fd2e5d4ef" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 46657 } } }
I20260811 07:31:50.663549 4469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:50.663612 4477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:50.667114 4477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:50.674396 4477 catalog_manager.cc:1347] Generated new cluster ID: 31e5967074c24f468998d7be4e102a18
I20260811 07:31:50.674530 4477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:50.687594 4477 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:50.689074 4477 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:50.703065 4477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05d8d21e03b544dd83d3c44fd2e5d4ef: Generated new TSK 0
I20260811 07:31:50.704103 4477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:50.718039 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4370
W20260811 07:31:50.728663 4352 connection.cc:535] client connection to 127.11.248.62:46657 recv error: Network error: failed to read from TLS socket (remote: 127.11.248.62:46657): Connection reset by peer (error 104)
2026-08-11T07:31:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1562 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:50 dist-test-slave-77v9 krb5kdc[4489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:50 dist-test-slave-77v9 krb5kdc[4489](info): set up 2 sockets
Aug 11 07:31:50 dist-test-slave-77v9 krb5kdc[4489](info): commencing operation
krb5kdc: starting...
W20260811 07:31:51.943200 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:52 dist-test-slave-77v9 krb5kdc[4489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:52.109342 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36239
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:34697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:36239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:52.232714 4504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:52.233157 4504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:52.233204 4504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:52.237604 4504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:52.237690 4504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:52.237712 4504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:52.237730 4504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:52.237746 4504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:52.243741 4504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:34697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:36239
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:36239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:52.245029 4504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:52.246090 4504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:52.256255 4514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:52.256347 4511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:52.256286 4512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:52.256609 4504 server_base.cc:1034] running on GCE node
I20260811 07:31:52.257470 4504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:52.258718 4504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:52.259948 4504 hybrid_clock.cc:648] HybridClock initialized: now 1786433512259928 us; error 40 us; skew 500 ppm
Aug 11 07:31:52 dist-test-slave-77v9 krb5kdc[4489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433512, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:52.263414 4504 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:52.265861 4504 webserver.cc:460] Webserver started at http://127.11.248.62:36387/ using document root <none> and password file <none>
I20260811 07:31:52.266572 4504 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:52.266667 4504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:52.266945 4504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:52.269537 4504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "768f0639e9f1442f89bc912a4dd10c59"
format_stamp: "Formatted at 2026-08-11 07:31:52 on dist-test-slave-77v9"
server_key: "f55836301980491a67c98c255b1b640b"
server_key_iv: "de900ddd438d3c11dd5848d35da67932"
server_key_version: "encryptionkey@0"
I20260811 07:31:52.270177 4504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "768f0639e9f1442f89bc912a4dd10c59"
format_stamp: "Formatted at 2026-08-11 07:31:52 on dist-test-slave-77v9"
server_key: "f55836301980491a67c98c255b1b640b"
server_key_iv: "de900ddd438d3c11dd5848d35da67932"
server_key_version: "encryptionkey@0"
I20260811 07:31:52.274849 4504 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:52.278012 4521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:52.279559 4504 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:52.279768 4504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "768f0639e9f1442f89bc912a4dd10c59"
format_stamp: "Formatted at 2026-08-11 07:31:52 on dist-test-slave-77v9"
server_key: "f55836301980491a67c98c255b1b640b"
server_key_iv: "de900ddd438d3c11dd5848d35da67932"
server_key_version: "encryptionkey@0"
I20260811 07:31:52.279924 4504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:52.286113 4504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:52.290118 4504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:52.290369 4504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:52.299080 4504 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:36239
I20260811 07:31:52.299109 4581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:36239 every 8 connection(s)
I20260811 07:31:52.300220 4504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:52.303304 4582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:52.308485 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4504
I20260811 07:31:52.308633 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:52.309065 12256 external_mini_cluster.cc:1428] Setting key df721c1a33aa63304de3a60f71314e21
I20260811 07:31:52.309932 4582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59: Bootstrap starting.
I20260811 07:31:52.312865 4582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:52.313918 4582 log.cc:824] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:52.315215 4585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:52.310703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59761 (local address 127.11.248.62:36239)
0811 07:31:52.311313 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:52.311331 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:52.311377 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:31:52.312113 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:52.312133 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:52.312486 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:52.312885 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:52.313798 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:52.313803 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:52.313814 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:52.313825 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:52.313884 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:52.313905 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:52.314026 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:52.314129 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 07:31:52.314297 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":191,"threads_started":1}
I20260811 07:31:52.316625 4582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59: No bootstrap required, opened a new log
I20260811 07:31:52.318353 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:52.321040 4582 raft_consensus.cc:348] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "768f0639e9f1442f89bc912a4dd10c59" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36239 } }
I20260811 07:31:52.321372 4582 raft_consensus.cc:374] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:52.321461 4582 raft_consensus.cc:729] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 768f0639e9f1442f89bc912a4dd10c59, State: Initialized, Role: FOLLOWER
I20260811 07:31:52.322024 4582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "768f0639e9f1442f89bc912a4dd10c59" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36239 } }
I20260811 07:31:52.322214 4582 raft_consensus.cc:388] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:52.322294 4582 raft_consensus.cc:482] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:52.322420 4582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:52.322813 4585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:52.320586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39931 (local address 127.11.248.62:36239)
0811 07:31:52.320736 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:52.320741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:52.321039 (+ 298us) server_negotiation.cc:407] Connection header received
0811 07:31:52.321207 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:52.321211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:52.321255 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:52.321341 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:52.322223 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:52.322226 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:52.322229 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:52.322241 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:52.322277 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:52.322292 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:52.322416 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:52.322591 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:31:52.322646 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:31:52.323609 4582 raft_consensus.cc:504] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "768f0639e9f1442f89bc912a4dd10c59" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36239 } }
I20260811 07:31:52.323987 4582 leader_election.cc:302] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 768f0639e9f1442f89bc912a4dd10c59; no voters:
I20260811 07:31:52.324335 4582 leader_election.cc:288] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:52.324484 4593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:52.324724 4593 raft_consensus.cc:686] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [term 1 LEADER]: Becoming Leader. State: Replica: 768f0639e9f1442f89bc912a4dd10c59, State: Running, Role: LEADER
I20260811 07:31:52.325381 4593 consensus_queue.cc:237] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "768f0639e9f1442f89bc912a4dd10c59" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36239 } }
I20260811 07:31:52.325807 4582 sys_catalog.cc:564] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:52.327545 4594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "768f0639e9f1442f89bc912a4dd10c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "768f0639e9f1442f89bc912a4dd10c59" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36239 } } }
I20260811 07:31:52.327850 4594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:52.327256 4595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 768f0639e9f1442f89bc912a4dd10c59. Latest consensus state: current_term: 1 leader_uuid: "768f0639e9f1442f89bc912a4dd10c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "768f0639e9f1442f89bc912a4dd10c59" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 36239 } } }
I20260811 07:31:52.329031 4595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59 [sys.catalog]: This master's current role is: LEADER
W20260811 07:31:52.331202 4610 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:52.331291 4610 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:52.331355 4609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:52.332278 4609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:52.338811 4609 catalog_manager.cc:1347] Generated new cluster ID: 423a772d4f5f45cab37edc213498db22
I20260811 07:31:52.338924 4609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:52.360742 4609 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:52.361280 4609 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:52.372020 4609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 768f0639e9f1442f89bc912a4dd10c59: Generated new TSK 0
I20260811 07:31:52.373150 4609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:52.380822 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4504
2026-08-11T07:31:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1662 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:52 dist-test-slave-77v9 krb5kdc[4617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:52 dist-test-slave-77v9 krb5kdc[4617](info): set up 2 sockets
Aug 11 07:31:52 dist-test-slave-77v9 krb5kdc[4617](info): commencing operation
krb5kdc: starting...
W20260811 07:31:53.523758 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:53 dist-test-slave-77v9 krb5kdc[4617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:53.680958 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:40041
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:40041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:53.809681 4634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:53.810086 4634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:53.810142 4634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:53.815798 4634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:53.815903 4634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:53.815925 4634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:53.815945 4634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:53.815961 4634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:53.822083 4634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:40041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:40041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:53.823266 4634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:53.824331 4634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:53.834326 4639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:53.834542 4634 server_base.cc:1034] running on GCE node
W20260811 07:31:53.834403 4642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:53.834642 4640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:53.835502 4634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:53.836917 4634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:53.838114 4634 hybrid_clock.cc:648] HybridClock initialized: now 1786433513838103 us; error 32 us; skew 500 ppm
Aug 11 07:31:53 dist-test-slave-77v9 krb5kdc[4617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:53.841584 4634 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:53.842653 4634 webserver.cc:460] Webserver started at http://127.11.248.62:44971/ using document root <none> and password file <none>
I20260811 07:31:53.843291 4634 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:53.843401 4634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:53.843665 4634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:53.846257 4634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "926b0c56e0594e67a61e2c955b4f6b5d"
format_stamp: "Formatted at 2026-08-11 07:31:53 on dist-test-slave-77v9"
server_key: "422cdfd29f80137e96ff5e629a68cd1d"
server_key_iv: "5717b305bc6d9d5827185a4bab7da5ba"
server_key_version: "encryptionkey@0"
I20260811 07:31:53.847035 4634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "926b0c56e0594e67a61e2c955b4f6b5d"
format_stamp: "Formatted at 2026-08-11 07:31:53 on dist-test-slave-77v9"
server_key: "422cdfd29f80137e96ff5e629a68cd1d"
server_key_iv: "5717b305bc6d9d5827185a4bab7da5ba"
server_key_version: "encryptionkey@0"
I20260811 07:31:53.852576 4634 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:31:53.855715 4650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:53.857365 4634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:53.857573 4634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "926b0c56e0594e67a61e2c955b4f6b5d"
format_stamp: "Formatted at 2026-08-11 07:31:53 on dist-test-slave-77v9"
server_key: "422cdfd29f80137e96ff5e629a68cd1d"
server_key_iv: "5717b305bc6d9d5827185a4bab7da5ba"
server_key_version: "encryptionkey@0"
I20260811 07:31:53.857730 4634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:53.870172 4634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:53.874118 4634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:53.874372 4634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:53.882860 4634 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:40041
I20260811 07:31:53.882882 4710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:40041 every 8 connection(s)
I20260811 07:31:53.883956 4634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:53.887089 4713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:53.890429 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4634
I20260811 07:31:53.890606 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:53.890937 12256 external_mini_cluster.cc:1428] Setting key 6806f5f8b5aa3954bcd57448b042e737
I20260811 07:31:53.894430 4713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d: Bootstrap starting.
I20260811 07:31:53.897333 4713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:53.898157 4713 log.cc:824] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:53.900509 4713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d: No bootstrap required, opened a new log
Aug 11 07:31:53 dist-test-slave-77v9 krb5kdc[4617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:53.905109 4713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40041 } }
I20260811 07:31:53.905454 4713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:53.905517 4713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b0c56e0594e67a61e2c955b4f6b5d, State: Initialized, Role: FOLLOWER
I20260811 07:31:53.906039 4713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40041 } }
I20260811 07:31:53.906226 4713 raft_consensus.cc:388] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:53.906299 4713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:53.906419 4713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:53.907780 4713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40041 } }
I20260811 07:31:53.908174 4713 leader_election.cc:302] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 926b0c56e0594e67a61e2c955b4f6b5d; no voters:
I20260811 07:31:53.908550 4713 leader_election.cc:288] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:53.908689 4720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:53.909054 4720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [term 1 LEADER]: Becoming Leader. State: Replica: 926b0c56e0594e67a61e2c955b4f6b5d, State: Running, Role: LEADER
I20260811 07:31:53.909207 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:53.892591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48093 (local address 127.11.248.62:40041)
0811 07:31:53.893213 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:53.893238 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:53.893288 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:31:53.894153 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:53.894177 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:53.894628 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:53.895016 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:53.895775 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:53.897323 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:53.898461 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:53.899036 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:53.899255 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:53.902314 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:53.902320 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:53.902340 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:53.902379 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:53.905373 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:53.905988 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:53.905994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:53.905999 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:53.906237 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:53.906595 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:53.906599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:53.906600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:53.907184 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:53.907405 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:53.907696 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 07:31:53.908063 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":275,"threads_started":1}
I20260811 07:31:53.909461 4720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40041 } }
I20260811 07:31:53.909915 4713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:53.910749 4720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 926b0c56e0594e67a61e2c955b4f6b5d. Latest consensus state: current_term: 1 leader_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40041 } } }
I20260811 07:31:53.910879 4720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:53.911552 4721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926b0c56e0594e67a61e2c955b4f6b5d" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 40041 } } }
I20260811 07:31:53.911664 4721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:53.911971 4730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:53.912561 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:53.915470 4730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:53.922592 4730 catalog_manager.cc:1347] Generated new cluster ID: 961dea3dc7f34697831ed9bedd1aea34
I20260811 07:31:53.922684 4730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:53.925127 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:53.915217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35729 (local address 127.11.248.62:40041)
0811 07:31:53.915339 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:53.915344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:53.915771 (+ 427us) server_negotiation.cc:407] Connection header received
0811 07:31:53.915847 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:53.915850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:53.915903 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:53.915991 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:53.917083 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:53.917851 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:53.918737 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:53.918997 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:53.919121 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:53.921299 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:53.921303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:53.921306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:53.921341 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:53.923209 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:53.923789 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:53.923793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:53.923795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:53.923885 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:53.924200 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:53.924203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:53.924205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:53.924417 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:53.924531 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:53.924839 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 07:31:53.924965 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:31:53.943418 4730 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:53.944645 4730 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:53.952499 4730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 926b0c56e0594e67a61e2c955b4f6b5d: Generated new TSK 0
I20260811 07:31:53.953419 4730 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:53.967374 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4634
2026-08-11T07:31:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1584 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:54 dist-test-slave-77v9 krb5kdc[4748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:54 dist-test-slave-77v9 krb5kdc[4748](info): set up 2 sockets
Aug 11 07:31:54 dist-test-slave-77v9 krb5kdc[4748](info): commencing operation
krb5kdc: starting...
W20260811 07:31:55.153342 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:55 dist-test-slave-77v9 krb5kdc[4748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:55.308056 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44077
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:40483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:44077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:55.437495 4763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:55.437852 4763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:55.437937 4763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:55.442356 4763 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:55.442468 4763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:55.442505 4763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:55.442545 4763 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:55.442579 4763 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:55.448565 4763 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:40483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:44077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:44077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:55.450157 4763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:55.451372 4763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:55.461589 4769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:55.461629 4772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:55.461618 4770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:55.461867 4763 server_base.cc:1034] running on GCE node
I20260811 07:31:55.463013 4763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:55.464468 4763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:55.465716 4763 hybrid_clock.cc:648] HybridClock initialized: now 1786433515465687 us; error 48 us; skew 500 ppm
Aug 11 07:31:55 dist-test-slave-77v9 krb5kdc[4748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:55.469156 4763 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:55.470228 4763 webserver.cc:460] Webserver started at http://127.11.248.62:39445/ using document root <none> and password file <none>
I20260811 07:31:55.470857 4763 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:55.470974 4763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:55.471233 4763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:55.473793 4763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc"
format_stamp: "Formatted at 2026-08-11 07:31:55 on dist-test-slave-77v9"
server_key: "af97bbcefb3f2d92b0a7c99962598dde"
server_key_iv: "d55f1dc559cf9cfc4d5c57fb82630738"
server_key_version: "encryptionkey@0"
I20260811 07:31:55.474462 4763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc"
format_stamp: "Formatted at 2026-08-11 07:31:55 on dist-test-slave-77v9"
server_key: "af97bbcefb3f2d92b0a7c99962598dde"
server_key_iv: "d55f1dc559cf9cfc4d5c57fb82630738"
server_key_version: "encryptionkey@0"
I20260811 07:31:55.478999 4763 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 07:31:55.482118 4780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:55.483518 4763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:31:55.483712 4763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc"
format_stamp: "Formatted at 2026-08-11 07:31:55 on dist-test-slave-77v9"
server_key: "af97bbcefb3f2d92b0a7c99962598dde"
server_key_iv: "d55f1dc559cf9cfc4d5c57fb82630738"
server_key_version: "encryptionkey@0"
I20260811 07:31:55.483865 4763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:55.508361 4763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:55.512696 4763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:55.513067 4763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:55.522298 4763 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:44077
I20260811 07:31:55.522301 4837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:44077 every 8 connection(s)
I20260811 07:31:55.523576 4763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:55.527216 4839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:55.527881 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4763
I20260811 07:31:55.528054 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:55.528429 12256 external_mini_cluster.cc:1428] Setting key 85bd91e4d11507b89a8de3b34873a7f4
I20260811 07:31:55.536345 4839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc: Bootstrap starting.
I20260811 07:31:55.539551 4839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:55.540585 4839 log.cc:824] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:55.540998 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:55.530280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47783 (local address 127.11.248.62:44077)
0811 07:31:55.530852 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:55.530875 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:55.530925 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:31:55.531821 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:55.531852 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:55.532404 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:55.532887 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:55.533394 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:55.535193 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:55.536499 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:55.537308 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:55.537515 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:55.538532 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:55.538540 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:55.538557 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:55.539134 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:55.539220 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:55.539257 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:55.539396 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:55.539593 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 07:31:55.539864 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":158,"threads_started":1}
I20260811 07:31:55.543061 4839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc: No bootstrap required, opened a new log
I20260811 07:31:55.544481 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:55.548115 4839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44077 } }
I20260811 07:31:55.548503 4839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:55.548614 4839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da5f465414a4bc4a4ccf3ec01ae0bcc, State: Initialized, Role: FOLLOWER
I20260811 07:31:55.549296 4839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44077 } }
I20260811 07:31:55.549497 4839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:55.549582 4839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:55.549700 4839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:55.551143 4839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44077 } }
I20260811 07:31:55.551626 4839 leader_election.cc:302] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8da5f465414a4bc4a4ccf3ec01ae0bcc; no voters:
I20260811 07:31:55.552134 4839 leader_election.cc:288] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:55.552312 4852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:55.552471 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:55.547117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46035 (local address 127.11.248.62:44077)
0811 07:31:55.547285 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:55.547290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:55.547563 (+ 273us) server_negotiation.cc:407] Connection header received
0811 07:31:55.547717 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:55.547719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:55.547771 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:55.547849 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:55.548217 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:55.549046 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:55.550314 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:55.550598 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:55.550692 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:55.551830 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:55.551834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:55.551837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:55.551854 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:55.551890 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:55.551905 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:55.552027 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:55.552145 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 07:31:55.552227 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:31:55.552794 4852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [term 1 LEADER]: Becoming Leader. State: Replica: 8da5f465414a4bc4a4ccf3ec01ae0bcc, State: Running, Role: LEADER
I20260811 07:31:55.553342 4852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44077 } }
I20260811 07:31:55.553833 4839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:55.554713 4852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8da5f465414a4bc4a4ccf3ec01ae0bcc. Latest consensus state: current_term: 1 leader_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44077 } } }
I20260811 07:31:55.554904 4852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:55.555248 4853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8da5f465414a4bc4a4ccf3ec01ae0bcc" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 44077 } } }
I20260811 07:31:55.555354 4853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:55.555467 4864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:55.559409 4864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:55.567678 4864 catalog_manager.cc:1347] Generated new cluster ID: 53903059726448999701b00ff69685e1
I20260811 07:31:55.567826 4864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:55.577690 4864 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:55.578964 4864 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:55.592296 4864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8da5f465414a4bc4a4ccf3ec01ae0bcc: Generated new TSK 0
I20260811 07:31:55.593362 4864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:55.618378 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4763
2026-08-11T07:31:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1651 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:55 dist-test-slave-77v9 krb5kdc[4876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:55 dist-test-slave-77v9 krb5kdc[4876](info): set up 2 sockets
Aug 11 07:31:55 dist-test-slave-77v9 krb5kdc[4876](info): commencing operation
krb5kdc: starting...
W20260811 07:31:56.769824 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:56 dist-test-slave-77v9 krb5kdc[4876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:56.930194 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34297
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:42719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:34297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:57.054147 4890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:57.054503 4890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:57.054556 4890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:57.059080 4890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:57.059181 4890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:57.059203 4890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:57.059221 4890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:57.059237 4890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:57.065968 4890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:34297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:34297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:57.067327 4890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:57.068424 4890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:57.079298 4896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:57.079319 4897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:57.079370 4890 server_base.cc:1034] running on GCE node
W20260811 07:31:57.079319 4899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:57.080309 4890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:57.081679 4890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:57.082969 4890 hybrid_clock.cc:648] HybridClock initialized: now 1786433517082962 us; error 40 us; skew 500 ppm
Aug 11 07:31:57 dist-test-slave-77v9 krb5kdc[4876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:57.086436 4890 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:57.087728 4890 webserver.cc:460] Webserver started at http://127.11.248.62:34533/ using document root <none> and password file <none>
I20260811 07:31:57.088407 4890 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:57.088512 4890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:57.088776 4890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:57.091114 4890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "8dca09baac19461282d8ef559078c75c"
format_stamp: "Formatted at 2026-08-11 07:31:57 on dist-test-slave-77v9"
server_key: "6943a9ba8fb0e2cc663621c0f969f459"
server_key_iv: "6a452236e08a6c32f1f7f77452cd31aa"
server_key_version: "encryptionkey@0"
I20260811 07:31:57.091770 4890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "8dca09baac19461282d8ef559078c75c"
format_stamp: "Formatted at 2026-08-11 07:31:57 on dist-test-slave-77v9"
server_key: "6943a9ba8fb0e2cc663621c0f969f459"
server_key_iv: "6a452236e08a6c32f1f7f77452cd31aa"
server_key_version: "encryptionkey@0"
I20260811 07:31:57.096190 4890 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 07:31:57.099386 4906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:57.101119 4890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:57.101316 4890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "8dca09baac19461282d8ef559078c75c"
format_stamp: "Formatted at 2026-08-11 07:31:57 on dist-test-slave-77v9"
server_key: "6943a9ba8fb0e2cc663621c0f969f459"
server_key_iv: "6a452236e08a6c32f1f7f77452cd31aa"
server_key_version: "encryptionkey@0"
I20260811 07:31:57.101468 4890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:57.106942 4890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:57.110889 4890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:57.111238 4890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:57.119889 4890 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:34297
I20260811 07:31:57.119920 4965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:34297 every 8 connection(s)
I20260811 07:31:57.121104 4890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:57.124346 4966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:57.129678 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 4890
I20260811 07:31:57.129860 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:57.130151 12256 external_mini_cluster.cc:1428] Setting key 43698390a59ac8e64c1c0bead343de73
I20260811 07:31:57.131748 4966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c: Bootstrap starting.
I20260811 07:31:57.134490 4966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:57.135392 4966 log.cc:824] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:57.136857 4969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:57.131846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45081 (local address 127.11.248.62:34297)
0811 07:31:57.132409 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:57.132427 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:57.132467 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:31:57.133269 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:57.133289 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:57.133617 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:57.134082 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:57.135054 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:57.135064 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:57.135083 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:57.135098 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:57.135176 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:57.135204 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:57.135322 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:57.135522 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 07:31:57.135929 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":169,"threads_started":1}
I20260811 07:31:57.137930 4966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c: No bootstrap required, opened a new log
I20260811 07:31:57.140240 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:57.143191 4966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dca09baac19461282d8ef559078c75c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34297 } }
I20260811 07:31:57.143499 4966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:31:57.143661 4966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dca09baac19461282d8ef559078c75c, State: Initialized, Role: FOLLOWER
I20260811 07:31:57.144227 4966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dca09baac19461282d8ef559078c75c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34297 } }
I20260811 07:31:57.144420 4966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:31:57.144503 4966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:31:57.144629 4966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:57.145358 4969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:57.143020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38455 (local address 127.11.248.62:34297)
0811 07:31:57.143166 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:57.143172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:57.143555 (+ 383us) server_negotiation.cc:407] Connection header received
0811 07:31:57.143698 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:57.143702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:57.143753 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:57.143854 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:57.144866 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:57.144870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:57.144873 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:31:57.144889 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:57.144931 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:31:57.144948 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:57.145053 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:57.145189 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 07:31:57.145233 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:31:57.146107 4966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dca09baac19461282d8ef559078c75c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34297 } }
I20260811 07:31:57.146598 4966 leader_election.cc:302] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dca09baac19461282d8ef559078c75c; no voters:
I20260811 07:31:57.147002 4966 leader_election.cc:288] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:31:57.147182 4977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:57.147555 4977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [term 1 LEADER]: Becoming Leader. State: Replica: 8dca09baac19461282d8ef559078c75c, State: Running, Role: LEADER
I20260811 07:31:57.147930 4977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dca09baac19461282d8ef559078c75c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34297 } }
I20260811 07:31:57.148432 4966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:57.149755 4979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dca09baac19461282d8ef559078c75c. Latest consensus state: current_term: 1 leader_uuid: "8dca09baac19461282d8ef559078c75c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dca09baac19461282d8ef559078c75c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34297 } } }
I20260811 07:31:57.149914 4979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:57.150339 4986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:57.150305 4978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dca09baac19461282d8ef559078c75c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dca09baac19461282d8ef559078c75c" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 34297 } } }
I20260811 07:31:57.150470 4978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:57.153759 4986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:57.160534 4986 catalog_manager.cc:1347] Generated new cluster ID: 682f2f4a8dd74888bb7f9efeb7e262d7
I20260811 07:31:57.160641 4986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:57.179106 4986 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:57.179572 4986 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:57.190472 4986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dca09baac19461282d8ef559078c75c: Generated new TSK 0
I20260811 07:31:57.191565 4986 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:31:57.208132 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 4890
2026-08-11T07:31:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1587 ms)
[----------] 18 tests from AuthTokenIssuingTest (28878 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:31:57 dist-test-slave-77v9 krb5kdc[5001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:31:57 dist-test-slave-77v9 krb5kdc[5001](info): set up 2 sockets
Aug 11 07:31:57 dist-test-slave-77v9 krb5kdc[5001](info): commencing operation
krb5kdc: starting...
W20260811 07:31:58.388127 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:31:58 dist-test-slave-77v9 krb5kdc[5001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:31:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:31:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:31:58.549353 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41851
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:42247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:41851,127.11.248.61:40365,127.11.248.60:41313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:31:58.674674 5016 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:31:58.675060 5016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:58.675087 5016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:58.675173 5016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:58.679831 5016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:58.679950 5016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:58.679973 5016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:58.679991 5016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:58.680008 5016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:58.686101 5016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:41851,127.11.248.61:40365,127.11.248.60:41313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:41851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:58.687364 5016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:58.688475 5016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:31:58.698045 5016 server_base.cc:1034] running on GCE node
W20260811 07:31:58.697985 5022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:58.697984 5023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:58.697978 5025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:58.699031 5016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:58.700278 5016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:58.701476 5016 hybrid_clock.cc:648] HybridClock initialized: now 1786433518701442 us; error 54 us; skew 500 ppm
Aug 11 07:31:58 dist-test-slave-77v9 krb5kdc[5001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:58.705277 5016 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:31:58.706539 5016 webserver.cc:460] Webserver started at http://127.11.248.62:33871/ using document root <none> and password file <none>
I20260811 07:31:58.707252 5016 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:58.707370 5016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:58.707654 5016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:58.710246 5016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "361a241a0fc642c09ac7fff21b32f31b"
format_stamp: "Formatted at 2026-08-11 07:31:58 on dist-test-slave-77v9"
server_key: "d846ba90d216a9f55deff47cef3d4a00"
server_key_iv: "bf6bb385b586c47b61e3fff01f950b06"
server_key_version: "encryptionkey@0"
I20260811 07:31:58.710968 5016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "361a241a0fc642c09ac7fff21b32f31b"
format_stamp: "Formatted at 2026-08-11 07:31:58 on dist-test-slave-77v9"
server_key: "d846ba90d216a9f55deff47cef3d4a00"
server_key_iv: "bf6bb385b586c47b61e3fff01f950b06"
server_key_version: "encryptionkey@0"
I20260811 07:31:58.715595 5016 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:31:58.718798 5033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:58.720505 5016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:31:58.720679 5016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "361a241a0fc642c09ac7fff21b32f31b"
format_stamp: "Formatted at 2026-08-11 07:31:58 on dist-test-slave-77v9"
server_key: "d846ba90d216a9f55deff47cef3d4a00"
server_key_iv: "bf6bb385b586c47b61e3fff01f950b06"
server_key_version: "encryptionkey@0"
I20260811 07:31:58.720898 5016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:58.744199 5016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:58.748457 5016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:58.748729 5016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:58.757820 5016 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:41851
I20260811 07:31:58.758206 5094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:41851 every 8 connection(s)
I20260811 07:31:58.759028 5016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:31:58.762295 5095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:58.766575 5095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:31:58.769129 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 5016
I20260811 07:31:58.769326 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:31:58.769724 12256 external_mini_cluster.cc:1428] Setting key f26c90baf83c83df77c5de56c517602a
Aug 11 07:31:58 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.248.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.61@KRBTEST.COM" created.
I20260811 07:31:58.786710 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.769345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41851 (local address 127.0.0.1:42488)
0811 07:31:58.769984 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.770045 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:58.771004 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:58.771939 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:58.771943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:58.772547 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:58.773020 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:58.773046 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:58.774772 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:58.774775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:58.775623 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:58.775634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:58.776348 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:58.776352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:58.776459 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:58.777296 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:58.777321 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:58.779530 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:58.782645 (+ 3115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:58.782661 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:58.782678 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:58.783100 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:58.783513 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:58.783519 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:58.783522 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:58.783666 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:58.784670 (+ 1004us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:58.784682 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:58.784947 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 07:31:58.785180 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 07:31:58.785713 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":99,"thread_start_us":186,"threads_started":1}
I20260811 07:31:58.786705 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.769346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.11.248.62:41851)
0811 07:31:58.770176 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:58.770190 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:58.770247 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:31:58.771369 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:58.771379 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:58.771666 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:58.771911 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:58.773246 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:58.774594 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:58.775768 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:58.776168 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:58.776381 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:58.780012 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:58.780020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:58.780035 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:58.780066 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:58.782460 (+ 2394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:58.783259 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:58.783265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:58.783267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:58.783402 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:58.783854 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:58.783861 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:58.783866 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:58.784513 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:58.784642 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:58.785309 (+ 667us) server_negotiation.cc:299] Negotiation successful
0811 07:31:58.785597 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":671,"spinlock_wait_cycles":6400,"thread_start_us":199,"threads_started":1}
I20260811 07:31:58.789837 5095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:31:58.791003 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.790571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:55200)
0811 07:31:58.790749 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.790874 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 07:31:58.791368 5035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
I20260811 07:31:58.792757 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.792440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:55208)
0811 07:31:58.792584 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.792676 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 07:31:58.792953 5095 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:40365: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab.
Entry for principal kudu/127.11.248.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab.
I20260811 07:31:58.809554 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:40365
--webserver_interface=127.11.248.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab
--principal=kudu/127.11.248.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:42247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:41851,127.11.248.61:40365,127.11.248.60:41313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:31:58.842342 5095 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } attempt: 1
I20260811 07:31:58.843423 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.843067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58508)
0811 07:31:58.843244 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.843326 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 07:31:58.844364 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.844106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58512)
0811 07:31:58.844232 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.844295 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:31:58.844523 5095 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:40365: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
I20260811 07:31:58.912751 5095 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } attempt: 2
I20260811 07:31:58.914192 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.913592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58528)
0811 07:31:58.913840 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.914101 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 07:31:58.915192 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:58.914924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58532)
0811 07:31:58.915058 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:58.915121 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:31:58.915336 5095 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:40365: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
W20260811 07:31:58.937938 5102 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:31:58.938298 5102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:58.938328 5102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:58.938444 5102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:31:58.942962 5102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:58.943073 5102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:58.943096 5102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:58.943117 5102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:58.943136 5102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:58.949304 5102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:41851,127.11.248.61:40365,127.11.248.60:41313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab
--principal=kudu/127.11.248.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:40365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.248.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:58.950623 5102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:58.951838 5102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:58.962014 5108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:58.962014 5107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:58.962018 5110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:58.962064 5102 server_base.cc:1034] running on GCE node
I20260811 07:31:58.963102 5102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:58.964500 5102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:58.965757 5102 hybrid_clock.cc:648] HybridClock initialized: now 1786433518965721 us; error 56 us; skew 500 ppm
Aug 11 07:31:58 dist-test-slave-77v9 krb5kdc[5001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:58.970909 5102 init.cc:377] Logged in from keytab as kudu/127.11.248.61@KRBTEST.COM (short username kudu)
I20260811 07:31:58.972309 5102 webserver.cc:460] Webserver started at http://127.11.248.61:42153/ using document root <none> and password file <none>
I20260811 07:31:58.973141 5102 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:58.973295 5102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:58.973587 5102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:58.976300 5102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data/instance:
uuid: "3b9cf8e292ea4a7187036e7690aa5f58"
format_stamp: "Formatted at 2026-08-11 07:31:58 on dist-test-slave-77v9"
server_key: "f90810d298912d9c116ce1304f3279db"
server_key_iv: "002ac627e4306bfac99c07270bad62a8"
server_key_version: "encryptionkey@0"
I20260811 07:31:58.977200 5102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal/instance:
uuid: "3b9cf8e292ea4a7187036e7690aa5f58"
format_stamp: "Formatted at 2026-08-11 07:31:58 on dist-test-slave-77v9"
server_key: "f90810d298912d9c116ce1304f3279db"
server_key_iv: "002ac627e4306bfac99c07270bad62a8"
server_key_version: "encryptionkey@0"
I20260811 07:31:58.982353 5102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:31:58.985988 5117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:58.987906 5102 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:31:58.988170 5102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal
uuid: "3b9cf8e292ea4a7187036e7690aa5f58"
format_stamp: "Formatted at 2026-08-11 07:31:58 on dist-test-slave-77v9"
server_key: "f90810d298912d9c116ce1304f3279db"
server_key_iv: "002ac627e4306bfac99c07270bad62a8"
server_key_version: "encryptionkey@0"
I20260811 07:31:58.988349 5102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:59.003455 5102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:59.006556 5095 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } attempt: 3
I20260811 07:31:59.007755 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.007405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58538)
0811 07:31:59.007601 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.007666 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 07:31:59.008417 5102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:59.008687 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.008396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58544)
0811 07:31:59.008521 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.008603 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 07:31:59.008675 5102 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260811 07:31:59.008854 5095 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:40365: Network error: Client connection negotiation failed: client connection to 127.11.248.61:40365: connect: Connection refused (error 111)
I20260811 07:31:59.017835 5102 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.61:40365
I20260811 07:31:59.018162 5178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.61:40365 every 8 connection(s)
I20260811 07:31:59.019150 5102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
I20260811 07:31:59.019363 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 5102
I20260811 07:31:59.019542 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-1/wal/instance
I20260811 07:31:59.019994 12256 external_mini_cluster.cc:1428] Setting key d3223af8b2bb07b63b46cb1a651853f1
I20260811 07:31:59.022862 5179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:59.027731 5179 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.248.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.60@KRBTEST.COM" created.
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:59.047403 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.030325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.11.248.62:41851)
0811 07:31:59.030518 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.030523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.031848 (+ 1325us) server_negotiation.cc:407] Connection header received
0811 07:31:59.033144 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.033148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.033219 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.033324 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.035288 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.036156 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.037764 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.038084 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.038239 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.042134 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.042138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.042140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.042174 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.044565 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.045380 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.045384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.045385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.045480 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.045953 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.045957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.045958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.046178 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.046311 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.047024 (+ 713us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.047195 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:31:59.048429 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.030844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41851 (local address 127.0.0.1:47882)
0811 07:31:59.031635 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.031696 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.032722 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.033537 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.033545 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.034266 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.035054 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.035073 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.036349 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.036352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.037567 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.037581 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.038304 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.038308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.038607 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.039436 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.039466 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.041820 (+ 2354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.044765 (+ 2945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.044774 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.044852 (+ 78us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.045223 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.045594 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.045598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.045600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.045812 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.046314 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.046325 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.046690 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.046936 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.047354 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":166,"threads_started":1}
I20260811 07:31:59.050256 5179 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab.
Entry for principal kudu/127.11.248.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab.
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:31:59.057696 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:41313
--webserver_interface=127.11.248.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab
--principal=kudu/127.11.248.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:42247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:41851,127.11.248.61:40365,127.11.248.60:41313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:31:59.061383 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.051082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58552)
0811 07:31:59.051231 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.051244 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.051332 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.051986 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.051989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.052205 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.052293 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.052299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.053458 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.053466 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.054015 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.054024 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.054706 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.054709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.054818 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.055624 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.055638 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.057242 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.059629 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.059634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.059636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.059841 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.060161 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.060166 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.060168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.060246 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.060767 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.060770 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.060894 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.061002 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.061163 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:31:59.061396 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.051218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58552 (local address 127.11.248.61:40365)
0811 07:31:59.051562 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.051574 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.051595 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:31:59.051634 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.051638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.051805 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.051989 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.052410 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.053310 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.054142 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.054576 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.054702 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.057425 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.057448 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.057463 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.057488 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.059481 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.059982 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.059987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.059989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.060063 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.060343 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.060346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.060347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.060646 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.060800 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.061103 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.061250 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":143,"threads_started":1}
I20260811 07:31:59.063519 5179 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:31:59.064661 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.064204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39370)
0811 07:31:59.064477 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.064578 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
W20260811 07:31:59.064983 5121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
I20260811 07:31:59.066216 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.065827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39378)
0811 07:31:59.065980 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.066134 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 07:31:59.066449 5179 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:41313: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
I20260811 07:31:59.115768 5179 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } attempt: 1
I20260811 07:31:59.117063 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.116522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39382)
0811 07:31:59.116731 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.116958 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260811 07:31:59.117965 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.117711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39388)
0811 07:31:59.117838 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.117900 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:31:59.118119 5179 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:41313: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
I20260811 07:31:59.152063 5095 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } attempt: 4
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:31:59.164429 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.152960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58556 (local address 127.11.248.61:40365)
0811 07:31:59.153113 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.153120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.153144 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:31:59.153335 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.153338 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.153400 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.153497 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.154041 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.154586 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.155512 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.155773 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.155899 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.159294 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.159306 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.159310 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.159348 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.162433 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.163060 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.163064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.163068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.163166 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.163488 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.163492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.163494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.163709 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.163831 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.164116 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.164250 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 07:31:59.164429 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.152796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58556)
0811 07:31:59.153072 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.153090 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.153218 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.153520 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.153523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.153764 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.153898 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.153907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.154708 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.154713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.155374 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.155384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.155918 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.155922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.156039 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.156708 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.156721 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.159011 (+ 2290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.162627 (+ 3616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.162632 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.162634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.162924 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.163283 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.163286 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.163288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.163388 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.163819 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.163823 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.163946 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.164060 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.164243 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260811 07:31:59.165663 5095 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:31:59.166501 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.166215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39400)
0811 07:31:59.166356 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.166417 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 07:31:59.167217 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.166994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39406)
0811 07:31:59.167103 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.167153 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 07:31:59.167383 5095 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:41313: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
I20260811 07:31:59.186357 5179 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } attempt: 2
I20260811 07:31:59.187458 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.187098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39422)
0811 07:31:59.187289 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.187367 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260811 07:31:59.187856 5186 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:31:59.188236 5186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:31:59.188302 5186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:31:59.188380 5186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 07:31:59.188462 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.188080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39426)
0811 07:31:59.188208 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.188353 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:31:59.188630 5179 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:41313: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
W20260811 07:31:59.193336 5186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:31:59.193439 5186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:31:59.193475 5186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:31:59.193532 5186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:31:59.193570 5186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:31:59.199648 5186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:42247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:41851,127.11.248.61:40365,127.11.248.60:41313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab
--principal=kudu/127.11.248.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:41313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.248.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:31:59.201020 5186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:31:59.202163 5186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:31:59.212610 5193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:31:59.212601 5192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:59.212675 5186 server_base.cc:1034] running on GCE node
W20260811 07:31:59.212601 5195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:31:59.213726 5186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:31:59.215062 5186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:31:59.216280 5186 hybrid_clock.cc:648] HybridClock initialized: now 1786433519216231 us; error 81 us; skew 500 ppm
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433519, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:31:59.219545 5186 init.cc:377] Logged in from keytab as kudu/127.11.248.60@KRBTEST.COM (short username kudu)
I20260811 07:31:59.220619 5186 webserver.cc:460] Webserver started at http://127.11.248.60:46193/ using document root <none> and password file <none>
I20260811 07:31:59.221280 5186 fs_manager.cc:359] Metadata directory not provided
I20260811 07:31:59.221351 5186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:31:59.221539 5186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:31:59.223784 5186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data/instance:
uuid: "890f1a042ce849138b758b277eac940f"
format_stamp: "Formatted at 2026-08-11 07:31:59 on dist-test-slave-77v9"
server_key: "5613c6d9788cf3ffcc8972b198c74ca9"
server_key_iv: "e888a8dc82f6239c30b44b0150453626"
server_key_version: "encryptionkey@0"
I20260811 07:31:59.224363 5186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal/instance:
uuid: "890f1a042ce849138b758b277eac940f"
format_stamp: "Formatted at 2026-08-11 07:31:59 on dist-test-slave-77v9"
server_key: "5613c6d9788cf3ffcc8972b198c74ca9"
server_key_iv: "e888a8dc82f6239c30b44b0150453626"
server_key_version: "encryptionkey@0"
I20260811 07:31:59.226547 5095 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } attempt: 1
I20260811 07:31:59.227491 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.227141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39428)
0811 07:31:59.227311 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.227392 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:31:59.228574 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.228199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39436)
0811 07:31:59.228421 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.228473 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260811 07:31:59.228876 5095 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:41313: Network error: Client connection negotiation failed: client connection to 127.11.248.60:41313: connect: Connection refused (error 111)
I20260811 07:31:59.229447 5186 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:31:59.232304 5202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:31:59.233832 5186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:31:59.234066 5186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal
uuid: "890f1a042ce849138b758b277eac940f"
format_stamp: "Formatted at 2026-08-11 07:31:59 on dist-test-slave-77v9"
server_key: "5613c6d9788cf3ffcc8972b198c74ca9"
server_key_iv: "e888a8dc82f6239c30b44b0150453626"
server_key_version: "encryptionkey@0"
I20260811 07:31:59.234211 5186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:31:59.252138 5186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:31:59.255828 5186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:31:59.256080 5186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:31:59.264065 5186 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.60:41313
I20260811 07:31:59.264389 5263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.60:41313 every 8 connection(s)
I20260811 07:31:59.265224 5186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
I20260811 07:31:59.267460 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 5186
I20260811 07:31:59.267704 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433213255187-12256-0/minicluster-data/master-2/wal/instance
I20260811 07:31:59.268072 12256 external_mini_cluster.cc:1428] Setting key 7c39ecf352a6d9d5e6a3589bb2ed6683
I20260811 07:31:59.268455 5264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:31:59.273931 5264 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
I20260811 07:31:59.279810 5179 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } attempt: 3
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433519, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
I20260811 07:31:59.286810 5268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.269661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39448 (local address 127.11.248.60:41313)
0811 07:31:59.270165 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.270185 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.270231 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:31:59.270988 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.271007 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.271404 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.271748 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.272964 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.274106 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.275346 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.276000 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.276164 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.279794 (+ 3630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.279800 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.279810 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.279840 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.282584 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.283190 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.283197 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.283204 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.283375 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.283732 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.283735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.283737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.284391 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.284635 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.285241 (+ 606us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.285621 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":167,"threads_started":1}
I20260811 07:31:59.287642 5269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.276113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:41851 (local address 127.0.0.1:47892)
0811 07:31:59.276657 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.276709 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.276955 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.277299 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.277307 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.277850 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.278058 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.278065 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.279246 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.279249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.280031 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.280042 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.280741 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.280745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.280919 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.281550 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.281570 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.283488 (+ 1918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.285684 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.285693 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.285699 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.285944 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.286267 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.286272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.286274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.286366 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.286899 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.286907 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.287045 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.287243 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.287456 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":272,"threads_started":1}
I20260811 07:31:59.287707 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.276255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47892 (local address 127.11.248.62:41851)
0811 07:31:59.276393 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.276397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.276828 (+ 431us) server_negotiation.cc:407] Connection header received
0811 07:31:59.277072 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.277075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.277127 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.277200 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.278204 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.279085 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.280259 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.280608 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.280739 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.283644 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.283648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.283651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.283709 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.285557 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.286064 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.286067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.286070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.286179 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.286472 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.286479 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.286481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.286764 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.286878 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.287336 (+ 458us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.287500 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 07:31:59.289547 5264 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:31:59.291569 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.280413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39452)
0811 07:31:59.280563 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.280581 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.280669 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.281319 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.281322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.281503 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.281643 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.281653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.282666 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.282672 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.283434 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.283470 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.284109 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.284114 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.284224 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.284710 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.284729 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.286503 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.289681 (+ 3178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.289685 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.289687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.289993 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.290343 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.290347 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.290349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.290457 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.291024 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.291027 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.291132 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.291240 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.291399 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 07:31:59.292255 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.280645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39452 (local address 127.11.248.60:41313)
0811 07:31:59.281058 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.281069 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.281085 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:31:59.281124 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.281129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.281178 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.281291 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.281779 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.282548 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.283602 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.283961 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.284508 (+ 547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.286650 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.286654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.286657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.286683 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.289543 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.290111 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.290114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.290116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.290214 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.290578 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.290582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.290584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.290796 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.291017 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.291908 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.292042 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":174,"threads_started":1}
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433519, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:31:59.296072 5095 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } attempt: 2
I20260811 07:31:59.296134 5179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: Bootstrap starting.
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:31:59.299486 5179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:59.300113 5269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.290174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:40365 (local address 127.0.0.1:58566)
0811 07:31:59.290490 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.290508 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.290579 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.290889 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.290893 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.291080 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.291214 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.291223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.292207 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.292211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.293095 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.293106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.293860 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.293869 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.293991 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.294602 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.294613 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.295997 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.298379 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.298381 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.298383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.298584 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.298886 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.298889 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.298891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.298981 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.299526 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.299529 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.299644 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.299775 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.299944 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260811 07:31:59.300164 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.290554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58566 (local address 127.11.248.61:40365)
0811 07:31:59.290670 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.290674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.290688 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:31:59.290726 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.290732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.290777 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.290855 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.291376 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.292083 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.293229 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.293599 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.293673 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.296195 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.296200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.296203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.296231 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.298066 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.298697 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.298701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.298703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.298791 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.299075 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.299079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.299081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.299396 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.299509 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.299854 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.299988 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:31:59.300915 5179 log.cc:824] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:59.301159 5264 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:31:59.301355 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.290427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.11.248.62:41851)
0811 07:31:59.291035 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.291039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.291052 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:31:59.291087 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.291091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.291134 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.291223 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.291999 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.292635 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.293805 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.294114 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.294283 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.297349 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.297353 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.297356 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.297384 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.299089 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.299610 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.299613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.299615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.299706 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.300076 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.300080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.300082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.300360 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.300560 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.301022 (+ 462us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.301172 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500}
I20260811 07:31:59.303572 5179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: No bootstrap required, opened a new log
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433519, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
I20260811 07:31:59.308781 5179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.309270 5179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b9cf8e292ea4a7187036e7690aa5f58, State: Initialized, Role: FOLLOWER
I20260811 07:31:59.309774 5179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
Aug 11 07:31:59 dist-test-slave-77v9 krb5kdc[5001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:31:59.311758 5179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:59.311895 5268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.301732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39466 (local address 127.11.248.60:41313)
0811 07:31:59.301857 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.301861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.302284 (+ 423us) server_negotiation.cc:407] Connection header received
0811 07:31:59.302420 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.302422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.302454 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.302496 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.302995 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.303675 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.304703 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.305065 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.305142 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.308245 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.308249 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.308251 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.308273 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.310161 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310619 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.310622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.310623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.310692 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310951 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.310954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.310956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.311174 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.311247 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.311564 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.311704 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:31:59.312321 5269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.301689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39466)
0811 07:31:59.302215 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.302231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.302335 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.302598 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.302601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.302780 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.302877 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.302885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.303796 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.303799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.304576 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.304587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.305267 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.305270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.305353 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.306540 (+ 1187us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.306555 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.308108 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.310285 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310289 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.310291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.310522 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.310779 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.310783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.310866 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.311308 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.311310 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.311394 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.312051 (+ 657us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.312188 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":34}
I20260811 07:31:59.312867 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.296528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:41313 (local address 127.0.0.1:39464)
0811 07:31:59.296764 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 07:31:59.296781 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:31:59.296905 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:31:59.301127 (+ 4222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:31:59.301132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:31:59.301301 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:31:59.301410 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.301421 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.302929 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.302933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.303739 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:31:59.303749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.304479 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.304483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:31:59.304585 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.305171 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:31:59.305186 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:31:59.306805 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:31:59.309443 (+ 2638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.309447 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.309450 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.309731 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.310240 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:31:59.310251 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:31:59.310361 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:31:59.312240 (+ 1879us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:31:59.312244 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:31:59.312367 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 07:31:59.312469 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 07:31:59.312632 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260811 07:31:59.314669 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.303187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58576 (local address 127.11.248.61:40365)
0811 07:31:59.303304 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.303308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.303461 (+ 153us) server_negotiation.cc:407] Connection header received
0811 07:31:59.303616 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.303619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.303657 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.303704 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.304590 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.305933 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.306876 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.307241 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.307347 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.310748 (+ 3401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.310755 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.310758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.310796 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.312659 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.313270 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.313275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.313287 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.313379 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.313704 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.313708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.313711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.313939 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.314165 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.314395 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.314522 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 07:31:59.316366 5264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: Bootstrap starting.
I20260811 07:31:59.316709 5273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.316910 5273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.319108 5264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: Neither blocks nor log segments found. Creating new log.
W20260811 07:31:59.319379 5286 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:59.319519 5286 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:59.319875 5264 log.cc:824] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:59.316428 5102 master_runner.cc:186] Error getting master registration for 127.11.248.62:41851: OK, instance_id { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" instance_seqno: 1786433518755241 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:31:59.320891 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.300628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39464 (local address 127.11.248.60:41313)
0811 07:31:59.300788 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.300793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.300860 (+ 67us) server_negotiation.cc:407] Connection header received
0811 07:31:59.300901 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.300907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.300960 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.301532 (+ 572us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.302056 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.302792 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.303894 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.304340 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.304897 (+ 557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.306953 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.306957 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.306960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.306985 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.309290 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310019 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.310024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.310028 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.310123 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.310490 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.310495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.310498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.312104 (+ 1606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.320378 (+ 8274us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.320490 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.320658 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":66,"spinlock_wait_cycles":1792}
I20260811 07:31:59.322321 5264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: No bootstrap required, opened a new log
I20260811 07:31:59.322345 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:31:59.324314 5095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b: Bootstrap starting.
I20260811 07:31:59.323849 5065 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "361a241a0fc642c09ac7fff21b32f31b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47900
I20260811 07:31:59.325536 5102 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:31:59.326671 5264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.326943 5264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890f1a042ce849138b758b277eac940f, State: Initialized, Role: FOLLOWER
I20260811 07:31:59.327317 5264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.327454 5095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b: Neither blocks nor log segments found. Creating new log.
I20260811 07:31:59.328162 5289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.328588 5289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.328730 5095 log.cc:824] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:31:59.328903 5264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:59.331614 5095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b: No bootstrap required, opened a new log
W20260811 07:31:59.334611 5301 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:59.334772 5301 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:59.334978 5095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.335237 5095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 361a241a0fc642c09ac7fff21b32f31b, State: Initialized, Role: FOLLOWER
I20260811 07:31:59.335593 5095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.333078 5186 master_runner.cc:186] Error getting master registration for 127.11.248.62:41851: OK, instance_id { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" instance_seqno: 1786433518755241 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:31:59.336418 5186 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:31:59.337121 5095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:31:59.337199 5065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:31:59.337353 5065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:59.338817 5065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.340548 5148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "361a241a0fc642c09ac7fff21b32f31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3b9cf8e292ea4a7187036e7690aa5f58"
I20260811 07:31:59.340801 5148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:59.342316 5148 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361a241a0fc642c09ac7fff21b32f31b in term 1.
I20260811 07:31:59.342761 5035 leader_election.cc:302] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 361a241a0fc642c09ac7fff21b32f31b, 3b9cf8e292ea4a7187036e7690aa5f58; no voters:
I20260811 07:31:59.342846 5305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.342991 5305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.343079 5305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:31:59.343182 5305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [term 1 LEADER]: Becoming Leader. State: Replica: 361a241a0fc642c09ac7fff21b32f31b, State: Running, Role: LEADER
I20260811 07:31:59.343596 5305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } }
I20260811 07:31:59.345655 5305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 361a241a0fc642c09ac7fff21b32f31b. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.345794 5305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:59.346655 5065 leader_election.cc:288] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [CANDIDATE]: Term 1 election: Requested vote from peers 3b9cf8e292ea4a7187036e7690aa5f58 (127.11.248.61:40365), 890f1a042ce849138b758b277eac940f (127.11.248.60:41313)
I20260811 07:31:59.348029 5231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "361a241a0fc642c09ac7fff21b32f31b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "890f1a042ce849138b758b277eac940f"
I20260811 07:31:59.348289 5231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:31:59.349858 5231 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 361a241a0fc642c09ac7fff21b32f31b in term 1.
I20260811 07:31:59.352000 5016 master_runner.cc:263] No leader master found from master 361a241a0fc642c09ac7fff21b32f31b
I20260811 07:31:59.352092 5016 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 07:31:59.355491 5318 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:31:59.355609 5318 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:31:59.357527 5321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:31:59.358562 5321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:31:59.372902 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.349714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39468 (local address 127.11.248.60:41313)
0811 07:31:59.349853 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.349857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.351351 (+ 1494us) server_negotiation.cc:407] Connection header received
0811 07:31:59.351772 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.351775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.351829 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.351880 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.354300 (+ 2420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.355106 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.358801 (+ 3695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.359179 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.359271 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.364551 (+ 5280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.364556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.364559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.364615 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.366700 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.370003 (+ 3303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.370009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.370011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.370127 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.370938 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.370942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.370944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.371205 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.371337 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.372481 (+ 1144us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.372653 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:31:59.374047 5185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.350405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58580 (local address 127.11.248.61:40365)
0811 07:31:59.350525 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.350529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.351687 (+ 1158us) server_negotiation.cc:407] Connection header received
0811 07:31:59.352924 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.352928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.352986 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.353040 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.355807 (+ 2767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.356600 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.360454 (+ 3854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.360934 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.361032 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.367373 (+ 6341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.367381 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.367385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.367422 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.369385 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.370485 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.370490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.370492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.370589 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.371698 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.371703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.371705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.371964 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.372084 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.373705 (+ 1621us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.373865 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:31:59.382191 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:31:59.349250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.11.248.62:41851)
0811 07:31:59.349381 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.349386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.365177 (+ 15791us) server_negotiation.cc:407] Connection header received
0811 07:31:59.365377 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.365381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.365438 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.365494 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.366493 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.367303 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.368505 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:31:59.369004 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:31:59.369089 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:31:59.371337 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:31:59.371342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:31:59.371345 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:31:59.371381 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:31:59.373256 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.380247 (+ 6991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.380253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.380255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.380428 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:31:59.380949 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:31:59.380953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:31:59.380955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:31:59.381237 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:31:59.381367 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:31:59.381826 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 07:31:59.382003 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:31:59.389029 5231 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [term 1 FOLLOWER]: Refusing update from remote peer 361a241a0fc642c09ac7fff21b32f31b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:59.389997 5319 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:59.395886 5289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 361a241a0fc642c09ac7fff21b32f31b. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.396052 5289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.397964 5148 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [term 1 FOLLOWER]: Refusing update from remote peer 361a241a0fc642c09ac7fff21b32f31b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:31:59.398787 5319 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:31:59.403712 5273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 361a241a0fc642c09ac7fff21b32f31b. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.403909 5273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.414618 5289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.414819 5289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.415493 5333 mvcc.cc:205] Tried to move back new op lower bound from 7317231695406051328 to 7317231695235248128. Current Snapshot: MvccSnapshot[applied={T|T < 7317231695406051328}]
I20260811 07:31:59.417853 5273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.418038 5273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:31:59.418810 5321 catalog_manager.cc:1347] Generated new cluster ID: 3590e00fe7644e17ba2303aaf5f0ed58
I20260811 07:31:59.418912 5321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:31:59.423928 5305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.424119 5305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:59.424269 5319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "361a241a0fc642c09ac7fff21b32f31b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "361a241a0fc642c09ac7fff21b32f31b" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 41851 } } peers { permanent_uuid: "3b9cf8e292ea4a7187036e7690aa5f58" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 40365 } } peers { permanent_uuid: "890f1a042ce849138b758b277eac940f" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 41313 } } }
I20260811 07:31:59.424378 5319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b [sys.catalog]: This master's current role is: LEADER
I20260811 07:31:59.424548 5332 mvcc.cc:205] Tried to move back new op lower bound from 7317231695406051328 to 7317231695235248128. Current Snapshot: MvccSnapshot[applied={T|T < 7317231695406051328 or (T in {7317231695406051328})}]
I20260811 07:31:59.439841 5321 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:31:59.441284 5321 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:31:59.453248 5321 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 361a241a0fc642c09ac7fff21b32f31b: Generated new TSK 0
I20260811 07:31:59.454273 5321 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:31:59.484905 5098 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.481461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.11.248.62:41851)
0811 07:31:59.481612 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.481618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.483554 (+ 1936us) server_negotiation.cc:407] Connection header received
0811 07:31:59.483784 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.483788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.483847 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.483905 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.484697 (+ 792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47910: BlockingRecv error: recv got EOF from 127.0.0.1:47910 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 07:31:59.486940 5270 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.482773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39474 (local address 127.11.248.60:41313)
0811 07:31:59.482901 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.482906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.485391 (+ 2485us) server_negotiation.cc:407] Connection header received
0811 07:31:59.485914 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.485918 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.485999 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.486061 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.486787 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39474: BlockingRecv error: recv got EOF from 127.0.0.1:39474 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 07:31:59.489151 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.487534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58588 (local address 127.11.248.61:40365)
0811 07:31:59.487662 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.487667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.488040 (+ 373us) server_negotiation.cc:407] Connection header received
0811 07:31:59.488234 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.488237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.488291 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.488346 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.489002 (+ 656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58588: BlockingRecv error: recv got EOF from 127.0.0.1:58588 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 07:31:59.498571 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.493341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58592 (local address 127.11.248.61:40365)
0811 07:31:59.493509 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.493516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.497255 (+ 3739us) server_negotiation.cc:407] Connection header received
0811 07:31:59.497575 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.497581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.497678 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.497740 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.498443 (+ 703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58592: BlockingRecv error: recv got EOF from 127.0.0.1:58592 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 07:31:59.507208 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.504990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58594 (local address 127.11.248.61:40365)
0811 07:31:59.505201 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.505211 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.505957 (+ 746us) server_negotiation.cc:407] Connection header received
0811 07:31:59.506220 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.506224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.506285 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.506361 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.507069 (+ 708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58594: BlockingRecv error: recv got EOF from 127.0.0.1:58594 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
W20260811 07:31:59.515793 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.513666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.11.248.61:40365)
0811 07:31:59.513818 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.513824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.514585 (+ 761us) server_negotiation.cc:407] Connection header received
0811 07:31:59.514831 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.514836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.514901 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.514962 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.515659 (+ 697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58608: BlockingRecv error: recv got EOF from 127.0.0.1:58608 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 07:31:59.525280 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.523161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58624 (local address 127.11.248.61:40365)
0811 07:31:59.523377 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.523383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.524052 (+ 669us) server_negotiation.cc:407] Connection header received
0811 07:31:59.524304 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.524308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.524387 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.524449 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.525142 (+ 693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58624: BlockingRecv error: recv got EOF from 127.0.0.1:58624 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
W20260811 07:31:59.538651 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.536411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58638 (local address 127.11.248.61:40365)
0811 07:31:59.536543 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.536548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.537298 (+ 750us) server_negotiation.cc:407] Connection header received
0811 07:31:59.537591 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.537594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.537653 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.537708 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.538522 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58638: BlockingRecv error: recv got EOF from 127.0.0.1:58638 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 07:31:59.560536 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.558281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58650 (local address 127.11.248.61:40365)
0811 07:31:59.558439 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.558444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.559180 (+ 736us) server_negotiation.cc:407] Connection header received
0811 07:31:59.559500 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.559507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.559588 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.559654 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.560385 (+ 731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58650: BlockingRecv error: recv got EOF from 127.0.0.1:58650 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 07:31:59.597455 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.595883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58662 (local address 127.11.248.61:40365)
0811 07:31:59.596078 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.596083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.596265 (+ 182us) server_negotiation.cc:407] Connection header received
0811 07:31:59.596409 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.596411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.596466 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.596549 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.597277 (+ 728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58662: BlockingRecv error: recv got EOF from 127.0.0.1:58662 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 07:31:59.665239 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.664109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58674 (local address 127.11.248.61:40365)
0811 07:31:59.664286 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.664289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.664362 (+ 73us) server_negotiation.cc:407] Connection header received
0811 07:31:59.664438 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.664441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.664489 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.664567 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.665132 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58674: BlockingRecv error: recv got EOF from 127.0.0.1:58674 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260811 07:31:59.797581 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:31:59.796114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58690 (local address 127.11.248.61:40365)
0811 07:31:59.796300 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:31:59.796305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:31:59.796450 (+ 145us) server_negotiation.cc:407] Connection header received
0811 07:31:59.796640 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:31:59.796650 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:31:59.796703 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:31:59.796811 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:31:59.797429 (+ 618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58690: BlockingRecv error: recv got EOF from 127.0.0.1:58690 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 07:32:00.057924 5185 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:00.056420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58700 (local address 127.11.248.61:40365)
0811 07:32:00.056624 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:00.056629 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:00.056647 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:00.056989 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:00.056999 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:00.057056 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:00.057162 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:00.057769 (+ 607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58700: BlockingRecv error: recv got EOF from 127.0.0.1:58700 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:32:00.321173 5286 catalog_manager.cc:1259] Loaded cluster ID: 3590e00fe7644e17ba2303aaf5f0ed58
I20260811 07:32:00.321278 5286 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: loading cluster ID for follower catalog manager: success
I20260811 07:32:00.323087 5286 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: acquiring CA information for follower catalog manager: success
I20260811 07:32:00.324373 5286 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b9cf8e292ea4a7187036e7690aa5f58: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:32:00.336377 5301 catalog_manager.cc:1259] Loaded cluster ID: 3590e00fe7644e17ba2303aaf5f0ed58
I20260811 07:32:00.336485 5301 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: loading cluster ID for follower catalog manager: success
I20260811 07:32:00.338840 5301 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: acquiring CA information for follower catalog manager: success
I20260811 07:32:00.340303 5301 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 890f1a042ce849138b758b277eac940f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:32:00.577447 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:00.572621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58702 (local address 127.11.248.61:40365)
0811 07:32:00.573034 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:00.573040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:00.573060 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:32:00.573362 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:00.573371 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:00.573523 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:00.573676 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:00.574054 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.574683 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.575621 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.575873 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.575994 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:00.576415 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:00.576985 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:00.577132 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:00.577176 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 07:32:00.577258 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":75,"threads_started":1}
I20260811 07:32:00.586162 5423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:00.581619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39488 (local address 127.11.248.60:41313)
0811 07:32:00.581893 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:00.581897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:00.581913 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:32:00.582010 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:00.582012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:00.582141 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:00.582252 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:00.582552 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.583186 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.584118 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.584362 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.584468 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:00.584971 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:00.585523 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:00.585664 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:00.585830 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 07:32:00.585906 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":109,"threads_started":1}
I20260811 07:32:00.595546 5417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:00.590679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.11.248.61:40365)
0811 07:32:00.590925 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:00.590931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:00.590968 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:32:00.591021 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:00.591023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:00.591069 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:00.591186 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:00.591535 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.592408 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.593632 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.593980 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.594101 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:00.594633 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:00.594767 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:00.594970 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:00.595190 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 07:32:00.595264 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260811 07:32:00.595709 5423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:00.590717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.11.248.60:41313)
0811 07:32:00.590914 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:00.590919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:00.591114 (+ 195us) server_negotiation.cc:407] Connection header received
0811 07:32:00.591248 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:00.591255 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:00.591321 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:00.591414 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:00.591741 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.592497 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.593944 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.594276 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.594363 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:00.594887 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:00.594989 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:00.595101 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:00.595515 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 07:32:00.595586 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260811 07:32:00.597146 5432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:00.590283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47916 (local address 127.11.248.62:41851)
0811 07:32:00.590576 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:00.590581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:00.590834 (+ 253us) server_negotiation.cc:407] Connection header received
0811 07:32:00.590972 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:00.590976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:00.591193 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:00.591336 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:00.591841 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.592627 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.594439 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:00.594946 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:00.595074 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:00.595601 (+ 527us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:00.596030 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:00.596141 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:00.596718 (+ 577us) server_negotiation.cc:299] Negotiation successful
0811 07:32:00.596981 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":91,"threads_started":1}
I20260811 07:32:00.601997 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 5016
I20260811 07:32:00.610543 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 5102
I20260811 07:32:00.619495 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 5186
2026-08-11T07:32:00Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3414 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:00 dist-test-slave-77v9 krb5kdc[5435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:00 dist-test-slave-77v9 krb5kdc[5435](info): set up 2 sockets
Aug 11 07:32:00 dist-test-slave-77v9 krb5kdc[5435](info): commencing operation
krb5kdc: starting...
W20260811 07:32:01.790752 12256 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/test-user.keytab.
Aug 11 07:32:01 dist-test-slave-77v9 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.248.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
Entry for principal kudu/127.11.248.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab.
I20260811 07:32:01.957501 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39061
--webserver_interface=127.11.248.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:39061,127.11.248.61:37627,127.11.248.60:34605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:02.086076 5449 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:32:02.086562 5449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:02.086654 5449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:02.086745 5449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:02.091353 5449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:02.091504 5449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:02.091549 5449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:02.091599 5449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:02.091640 5449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:02.098076 5449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:39061,127.11.248.61:37627,127.11.248.60:34605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.62.keytab
--principal=kudu/127.11.248.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.62:39061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.248.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:02.099467 5449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:02.100669 5449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:02.110845 5455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:02.110845 5458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:02.110956 5456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:02.111361 5449 server_base.cc:1034] running on GCE node
I20260811 07:32:02.112021 5449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:02.113440 5449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:02.114650 5449 hybrid_clock.cc:648] HybridClock initialized: now 1786433522114615 us; error 54 us; skew 500 ppm
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:02.118292 5449 init.cc:377] Logged in from keytab as kudu/127.11.248.62@KRBTEST.COM (short username kudu)
I20260811 07:32:02.119441 5449 webserver.cc:460] Webserver started at http://127.11.248.62:46607/ using document root <none> and password file <none>
I20260811 07:32:02.120097 5449 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:02.120209 5449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:02.120477 5449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:02.122915 5449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data/instance:
uuid: "5c428b2613f74c02b2cdc425763de8f5"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "f637c4e97fb462d058dc82267bd3e22f"
server_key_iv: "028d2a28183b0a1edf5258553cb8e651"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.123675 5449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal/instance:
uuid: "5c428b2613f74c02b2cdc425763de8f5"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "f637c4e97fb462d058dc82267bd3e22f"
server_key_iv: "028d2a28183b0a1edf5258553cb8e651"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.128137 5449 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:32:02.131306 5466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:02.133157 5449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:32:02.133350 5449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal
uuid: "5c428b2613f74c02b2cdc425763de8f5"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "f637c4e97fb462d058dc82267bd3e22f"
server_key_iv: "028d2a28183b0a1edf5258553cb8e651"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.133517 5449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:02.151409 5449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:02.155439 5449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:02.155691 5449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:02.164710 5449 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.62:39061
I20260811 07:32:02.165103 5522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.62:39061 every 8 connection(s)
I20260811 07:32:02.166013 5449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:02.167814 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 5449
I20260811 07:32:02.167970 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-0/wal/instance
I20260811 07:32:02.168308 12256 external_mini_cluster.cc:1428] Setting key dc1deec3559e48fa72f6a80c51f9c805
I20260811 07:32:02.169976 5523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:02.176390 5523 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.248.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.61@KRBTEST.COM" created.
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:32:02.197598 5527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.179766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53226 (local address 127.11.248.62:39061)
0811 07:32:02.180464 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.180486 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.180751 (+ 265us) server_negotiation.cc:407] Connection header received
0811 07:32:02.182239 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.182244 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.182545 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.182786 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.184105 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.185409 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.186665 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.187182 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.187461 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.191182 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.191189 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.191203 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.191236 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.193435 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.194209 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.194215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.194217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.194386 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.194901 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.194904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.194906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.195423 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.195678 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.196072 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.196364 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":527,"spinlock_wait_cycles":38272,"thread_start_us":202,"threads_started":1}
I20260811 07:32:02.197599 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.179766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39061 (local address 127.0.0.1:53226)
0811 07:32:02.180561 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.180619 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.181728 (+ 1109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.182844 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.182854 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.183386 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.183826 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.183851 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.185579 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.185583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.186501 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.186513 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.187390 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.187394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.187643 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.188428 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.188450 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.190930 (+ 2480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.193609 (+ 2679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.193627 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.193643 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.194043 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.194522 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.194528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.194530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.194717 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.195636 (+ 919us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.195643 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.195796 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.195971 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.196454 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":269,"thread_start_us":200,"threads_started":1}
I20260811 07:32:02.200448 5523 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:32:02.201567 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.201240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50128)
0811 07:32:02.201381 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.201486 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 07:32:02.201920 5469 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
I20260811 07:32:02.203085 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.202823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50138)
0811 07:32:02.202965 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.203017 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:32:02.203303 5523 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:37627: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab.
Entry for principal kudu/127.11.248.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab.
I20260811 07:32:02.205852 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:37627
--webserver_interface=127.11.248.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab
--principal=kudu/127.11.248.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:39061,127.11.248.61:37627,127.11.248.60:34605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:32:02.252687 5523 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } attempt: 1
I20260811 07:32:02.253810 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.253468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50144)
0811 07:32:02.253648 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.253721 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 07:32:02.254652 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.254425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50160)
0811 07:32:02.254542 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.254592 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:32:02.254842 5523 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:37627: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
I20260811 07:32:02.323042 5523 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } attempt: 2
I20260811 07:32:02.324070 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.323724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50176)
0811 07:32:02.323916 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.323987 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 07:32:02.325001 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.324720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50186)
0811 07:32:02.324880 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.324930 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 07:32:02.325233 5523 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:37627: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
W20260811 07:32:02.328176 5530 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:32:02.328502 5530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:02.328565 5530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:02.328641 5530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:02.333130 5530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:02.333213 5530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:02.333233 5530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:02.333251 5530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:02.333292 5530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:02.339394 5530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:39061,127.11.248.61:37627,127.11.248.60:34605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.61.keytab
--principal=kudu/127.11.248.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.61:37627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.248.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:02.340695 5530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:02.341888 5530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:32:02.351883 5530 server_base.cc:1034] running on GCE node
W20260811 07:32:02.351827 5536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:02.351827 5538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:02.351930 5535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:02.353031 5530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:02.354483 5530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:02.355722 5530 hybrid_clock.cc:648] HybridClock initialized: now 1786433522355693 us; error 48 us; skew 500 ppm
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:02.359230 5530 init.cc:377] Logged in from keytab as kudu/127.11.248.61@KRBTEST.COM (short username kudu)
I20260811 07:32:02.360486 5530 webserver.cc:460] Webserver started at http://127.11.248.61:45605/ using document root <none> and password file <none>
I20260811 07:32:02.361238 5530 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:02.361366 5530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:02.361646 5530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:02.364249 5530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data/instance:
uuid: "6c86dabf41d74c978b03094b42a58f78"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "b11b9789187b74f4e8d57f0abf68fd02"
server_key_iv: "7470a9940f9a6affa68b3a45015094e4"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.365063 5530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal/instance:
uuid: "6c86dabf41d74c978b03094b42a58f78"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "b11b9789187b74f4e8d57f0abf68fd02"
server_key_iv: "7470a9940f9a6affa68b3a45015094e4"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.369671 5530 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:02.372777 5545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:02.374477 5530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 07:32:02.374679 5530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal
uuid: "6c86dabf41d74c978b03094b42a58f78"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "b11b9789187b74f4e8d57f0abf68fd02"
server_key_iv: "7470a9940f9a6affa68b3a45015094e4"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.374836 5530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:02.409550 5530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:02.413861 5530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:02.414153 5530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:02.416496 5523 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } attempt: 3
I20260811 07:32:02.417543 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.417181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50196)
0811 07:32:02.417362 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.417454 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 07:32:02.418500 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.418192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50206)
0811 07:32:02.418341 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.418410 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:32:02.418660 5523 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.61:37627: Network error: Client connection negotiation failed: client connection to 127.11.248.61:37627: connect: Connection refused (error 111)
I20260811 07:32:02.423740 5530 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.61:37627
I20260811 07:32:02.423978 5606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.61:37627 every 8 connection(s)
I20260811 07:32:02.425369 5530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/data/info.pb
I20260811 07:32:02.429064 5607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:02.433720 5607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:32:02.435681 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 5530
I20260811 07:32:02.435966 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-1/wal/instance
I20260811 07:32:02.436321 12256 external_mini_cluster.cc:1428] Setting key 9b31bda332515edec2ff55209542d728
WARNING: no policy specified for kudu/127.11.248.60@KRBTEST.COM; defaulting to no policy
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.248.60@KRBTEST.COM" created.
I20260811 07:32:02.452692 5527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.436150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53238 (local address 127.11.248.62:39061)
0811 07:32:02.436576 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.436580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.437763 (+ 1183us) server_negotiation.cc:407] Connection header received
0811 07:32:02.439394 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.439397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.439471 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.439570 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.441469 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.442428 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.443899 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.444361 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.444519 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.447865 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.447869 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.447871 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.447905 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.449603 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.450622 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.450627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.450629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.450745 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.451186 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.451192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.451197 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.451507 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.451619 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.452251 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.452426 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313}
I20260811 07:32:02.453919 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.436669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39061 (local address 127.0.0.1:53238)
0811 07:32:02.437569 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.437634 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.439039 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.439847 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.439860 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.440557 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.441237 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.441256 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.442620 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.442623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.443710 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.443723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.444564 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.444567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.444749 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.445627 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.445647 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.447627 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.449856 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.449867 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.449891 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.450430 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.450860 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.450863 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.450864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.451066 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.451623 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.451630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.451944 (+ 314us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.452128 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.452486 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":182,"threads_started":1}
I20260811 07:32:02.455734 5607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:32:02.470242 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.456412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50208)
0811 07:32:02.457003 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.457023 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.457153 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.457660 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.457666 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.457933 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.458120 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.458132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.459259 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.459265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.460313 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.460327 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.461321 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.461328 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.461475 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.462101 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.462125 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.465704 (+ 3579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.468216 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.468219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.468221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.468452 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.468760 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.468762 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.468764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.468991 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.469569 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.469571 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.469721 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.469836 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.470022 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474}
I20260811 07:32:02.470394 5612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.456599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50208 (local address 127.11.248.61:37627)
0811 07:32:02.457021 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.457032 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.457101 (+ 69us) server_negotiation.cc:407] Connection header received
0811 07:32:02.457280 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.457286 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.457502 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.457621 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.458275 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.459106 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.460484 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.461143 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.461279 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.465927 (+ 4648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.465952 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.465970 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.466002 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.468072 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.468574 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.468579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.468581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.468668 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.469108 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.469111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.469112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.469449 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.469658 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.469927 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.470088 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":304,"thread_start_us":186,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.248.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab.
Entry for principal kudu/127.11.248.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab.
I20260811 07:32:02.472630 12256 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
/tmp/dist-test-taskMRD5fR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:34605
--webserver_interface=127.11.248.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab
--principal=kudu/127.11.248.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.248.20:33205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.248.62:39061,127.11.248.61:37627,127.11.248.60:34605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:32:02.472715 5607 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:32:02.473647 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.473314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48708)
0811 07:32:02.473467 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.473568 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:32:02.473925 5546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
I20260811 07:32:02.475086 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.474816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48718)
0811 07:32:02.474967 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.475021 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:32:02.475257 5607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:34605: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
I20260811 07:32:02.524591 5607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } attempt: 1
I20260811 07:32:02.525784 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.525432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48724)
0811 07:32:02.525617 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.525697 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 07:32:02.526813 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.526533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48738)
0811 07:32:02.526668 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.526732 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:32:02.527064 5607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:34605: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
I20260811 07:32:02.561884 5523 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } attempt: 4
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:32:02.574092 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.562679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50222)
0811 07:32:02.562981 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.563002 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.563124 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.563496 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.563499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.563700 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.563921 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.563929 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.565993 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.565996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.566615 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.566628 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.567372 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.567376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.567507 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.568218 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.568231 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.569846 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.572231 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.572235 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.572236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.572492 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.572938 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.572941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.572943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.573049 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.573554 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.573557 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.573667 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.573768 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.573937 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202}
I20260811 07:32:02.574175 5612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.562802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50222 (local address 127.11.248.61:37627)
0811 07:32:02.563010 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.563017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.563094 (+ 77us) server_negotiation.cc:407] Connection header received
0811 07:32:02.563225 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.563228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.563293 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.563423 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.564076 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.565824 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.566782 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.567196 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.567335 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.570064 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.570068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.570072 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.570108 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.572065 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.572617 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.572623 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.572625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.572733 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.573165 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.573168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.573170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.573437 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.573547 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.573852 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.574017 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:32:02.575295 5523 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:32:02.576251 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.575940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48740)
0811 07:32:02.576102 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.576174 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 07:32:02.577180 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.576935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48750)
0811 07:32:02.577050 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.577120 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 07:32:02.577375 5523 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:34605: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
I20260811 07:32:02.595307 5607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } attempt: 2
I20260811 07:32:02.596288 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.595947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48766)
0811 07:32:02.596120 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.596199 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 07:32:02.597317 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.597066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48778)
0811 07:32:02.597190 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.597248 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 07:32:02.597513 5607 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:34605: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
W20260811 07:32:02.604358 5614 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:32:02.604724 5614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:02.604751 5614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:02.604871 5614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:02.609269 5614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:02.609359 5614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:02.609380 5614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:02.609397 5614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:02.609413 5614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:02.615384 5614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.248.20:33205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.248.62:39061,127.11.248.61:37627,127.11.248.60:34605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/krb5kdc/kudu_127.11.248.60.keytab
--principal=kudu/127.11.248.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.248.60:34605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.248.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:02.617156 5614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:02.618441 5614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:32:02.628405 5614 server_base.cc:1034] running on GCE node
W20260811 07:32:02.628422 5619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:02.628448 5620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:02.628646 5622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:02.629500 5614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:02.630955 5614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:02.632225 5614 hybrid_clock.cc:648] HybridClock initialized: now 1786433522632191 us; error 58 us; skew 500 ppm
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:02.635568 5614 init.cc:377] Logged in from keytab as kudu/127.11.248.60@KRBTEST.COM (short username kudu)
I20260811 07:32:02.636559 5523 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } attempt: 1
I20260811 07:32:02.636741 5614 webserver.cc:460] Webserver started at http://127.11.248.60:45931/ using document root <none> and password file <none>
I20260811 07:32:02.637450 5614 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:02.637555 5614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:02.637615 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.637260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48784)
0811 07:32:02.637436 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.637506 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 07:32:02.637881 5614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:02.638387 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.638155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48794)
0811 07:32:02.638271 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.638330 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 07:32:02.638566 5523 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.248.60:34605: Network error: Client connection negotiation failed: client connection to 127.11.248.60:34605: connect: Connection refused (error 111)
I20260811 07:32:02.640338 5614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data/instance:
uuid: "e8f3fa8b2854479d9e56f88844384eb2"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "ef3ea3e7f612e266b64f1d4ddb4afbe6"
server_key_iv: "3d5d68179645bf0393caffe4a7f725ea"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.641062 5614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal/instance:
uuid: "e8f3fa8b2854479d9e56f88844384eb2"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "ef3ea3e7f612e266b64f1d4ddb4afbe6"
server_key_iv: "3d5d68179645bf0393caffe4a7f725ea"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.645464 5614 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:32:02.648494 5630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:02.650146 5614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:32:02.650350 5614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data,/tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal
uuid: "e8f3fa8b2854479d9e56f88844384eb2"
format_stamp: "Formatted at 2026-08-11 07:32:02 on dist-test-slave-77v9"
server_key: "ef3ea3e7f612e266b64f1d4ddb4afbe6"
server_key_iv: "3d5d68179645bf0393caffe4a7f725ea"
server_key_version: "encryptionkey@0"
I20260811 07:32:02.650518 5614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:02.664152 5614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:02.668694 5614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:02.669096 5614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:02.678532 5614 rpc_server.cc:307] RPC server started. Bound to: 127.11.248.60:34605
I20260811 07:32:02.679086 5684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.248.60:34605 every 8 connection(s)
I20260811 07:32:02.679889 5614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/data/info.pb
I20260811 07:32:02.682920 12256 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu as pid 5614
I20260811 07:32:02.683127 12256 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMRD5fR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433213255187-12256-0/minicluster-data/master-2/wal/instance
I20260811 07:32:02.683283 5686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:02.683511 12256 external_mini_cluster.cc:1428] Setting key c51489cddc38c84c9c653767f160d1cc
I20260811 07:32:02.688716 5607 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } attempt: 3
I20260811 07:32:02.688696 5686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.61@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:32:02.702019 5609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.689330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48808)
0811 07:32:02.689580 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.689606 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.689702 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.690072 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.690075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.690287 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.690377 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.690382 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.691544 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.691548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.692343 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.692356 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.693333 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.693342 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.693442 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.694056 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.694073 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.695568 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.699356 (+ 3788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.699362 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.699376 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.699690 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.700179 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.700182 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.700185 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.700296 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.701408 (+ 1112us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.701414 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.701527 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.701650 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.701831 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260811 07:32:02.703416 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.685130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.11.248.60:34605)
0811 07:32:02.685846 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.685876 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.685924 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:32:02.686950 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.686975 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.687523 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.688069 (+ 546us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.689167 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.690758 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.691985 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.692717 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.692944 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.697580 (+ 4636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.697583 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.697586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.697613 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.699588 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.700179 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.700183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.700184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.700271 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.700654 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.700657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.700659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.701186 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.701386 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.702823 (+ 1437us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.702954 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":526,"spinlock_wait_cycles":1920,"thread_start_us":205,"threads_started":1}
I20260811 07:32:02.703421 5690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.689396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.11.248.60:34605)
0811 07:32:02.689842 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.689853 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.689873 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:32:02.689903 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.689905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.689938 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.690040 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.690504 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.691400 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.692477 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.692916 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.693023 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.695856 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.695867 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.695892 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.695927 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.699208 (+ 3281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.699821 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.699830 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.699838 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.700039 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.700444 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.700449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.700450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.701186 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.701330 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.701834 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.702200 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":364,"spinlock_wait_cycles":1280,"thread_start_us":192,"threads_started":1}
I20260811 07:32:02.704592 5692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.690956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.62:39061 (local address 127.0.0.1:53242)
0811 07:32:02.691765 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.691811 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.691965 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.692311 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.692317 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.692902 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.693069 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.693077 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.694228 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.694234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.695725 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.695741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.696620 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.696625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.696841 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.697920 (+ 1079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.697935 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.700444 (+ 2509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.702601 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.702611 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.702617 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.702912 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.703282 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.703284 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.703286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.703423 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.703920 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.703926 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.704055 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.704205 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.704406 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":101,"threads_started":1}
I20260811 07:32:02.704605 5527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.691149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.11.248.62:39061)
0811 07:32:02.691309 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.691313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.691911 (+ 598us) server_negotiation.cc:407] Connection header received
0811 07:32:02.692084 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.692088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.692147 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.692245 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.693303 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.694068 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.695888 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.696288 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.696453 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.700656 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.700661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.700664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.700707 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.702457 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.703052 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.703057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.703058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.703161 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.703551 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.703555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.703557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.703807 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.703925 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.704303 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.704444 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:32:02.705821 5523 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } attempt: 2
I20260811 07:32:02.707599 5686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:32:02.709308 5607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: Bootstrap starting.
I20260811 07:32:02.712613 5607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:02.713778 5607 log.cc:824] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.62@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
I20260811 07:32:02.716977 5607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: No bootstrap required, opened a new log
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.62@KRBTEST.COM
I20260811 07:32:02.719440 5526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.706379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48814)
0811 07:32:02.706729 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.706749 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.706852 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.708720 (+ 1868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.708724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.709016 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.709170 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.709183 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.710799 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.710804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.711767 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.711781 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.712624 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.712632 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.712760 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.713359 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.713378 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.715197 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.717454 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.717460 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.717465 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.717759 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.718095 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.718098 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.718100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.718322 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.718812 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.718815 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.718936 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.719042 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.719228 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236}
I20260811 07:32:02.719521 5612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.708444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50230 (local address 127.11.248.61:37627)
0811 07:32:02.708594 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.708603 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.708625 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:32:02.708782 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.708799 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.708892 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.708949 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.709813 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.710516 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.711662 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.711994 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.712093 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.715492 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.715496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.715498 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.715523 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.717433 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.718066 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.718072 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.718074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.718166 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.718530 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.718533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.718535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.718820 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.718891 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.719244 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.719374 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:32:02.720157 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.707039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48814 (local address 127.11.248.60:34605)
0811 07:32:02.708424 (+ 1385us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.708432 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.708452 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:32:02.708497 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.708501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.708552 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.709362 (+ 810us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.709650 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.710591 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.711979 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.712467 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.713076 (+ 609us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.715394 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.715398 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.715401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.715430 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.717271 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.717885 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.717889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.717891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.717975 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.718428 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.718431 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.718433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.718667 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.718759 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.719860 (+ 1101us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.719996 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":1293,"spinlock_wait_cycles":225024}
I20260811 07:32:02.720690 5692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.708208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.61:37627 (local address 127.0.0.1:50230)
0811 07:32:02.708572 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.708587 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.708667 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.709102 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.709105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.709360 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.709655 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.709664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.710669 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.710674 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.711515 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.711526 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.712276 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.712280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.712419 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.713141 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.713157 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.715331 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.717649 (+ 2318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.717654 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.717656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.717935 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.718327 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.718330 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.718331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.718423 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.718965 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.718968 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.719062 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.720139 (+ 1077us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.720542 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":30,"spinlock_wait_cycles":19584}
I20260811 07:32:02.721742 5686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:32:02.723304 5607 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.723613 5527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.707690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53256 (local address 127.11.248.62:39061)
0811 07:32:02.707846 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.707852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.708121 (+ 269us) server_negotiation.cc:407] Connection header received
0811 07:32:02.708328 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.708334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.708395 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.708667 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.709810 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.710657 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.712007 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.712400 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.712508 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.718047 (+ 5539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.718052 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.718055 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.718089 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.720309 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.721094 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.721099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.721102 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.721230 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.721699 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.721706 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.721708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.722021 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.722725 (+ 704us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.723246 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.723418 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:32:02.723632 5607 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c86dabf41d74c978b03094b42a58f78, State: Initialized, Role: FOLLOWER
I20260811 07:32:02.724092 5607 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.724617 5523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5: Bootstrap starting.
I20260811 07:32:02.726059 5607 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:02.727845 5523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5: Neither blocks nor log segments found. Creating new log.
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433522, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.248.60@KRBTEST.COM for kudu/127.11.248.60@KRBTEST.COM
I20260811 07:32:02.728912 5523 log.cc:824] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:02.731592 5523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5: No bootstrap required, opened a new log
I20260811 07:32:02.733037 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.722367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48828 (local address 127.11.248.60:34605)
0811 07:32:02.722498 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.722506 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.722590 (+ 84us) server_negotiation.cc:407] Connection header received
0811 07:32:02.722753 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.722756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.722805 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.722850 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.723401 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.724119 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.725609 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.725941 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.726031 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.729029 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.729033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.729036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.729074 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.730993 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.731483 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.731486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.731488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.731565 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.732090 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.732094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.732096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.732308 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.732381 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.732684 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.732878 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 07:32:02.733767 5692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.722335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.248.60:34605 (local address 127.0.0.1:48828)
0811 07:32:02.722503 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:02.722523 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:02.722662 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:02.722979 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:02.722982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:02.723187 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:02.723280 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.723287 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.724616 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.724619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.725481 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:02.725493 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.726266 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.726269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:02.726351 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.726977 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:02.726992 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:02.728861 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:02.731120 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.731123 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.731125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.731377 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.731750 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:02.731754 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:02.731756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:02.731983 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:02.732439 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:02.732441 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:02.732520 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 07:32:02.733438 (+ 918us) client_negotiation.cc:240] Negotiation successful
0811 07:32:02.733603 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
Aug 11 07:32:02 dist-test-slave-77v9 krb5kdc[5435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.248.61@KRBTEST.COM
I20260811 07:32:02.735988 5523 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.736306 5523 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c428b2613f74c02b2cdc425763de8f5, State: Initialized, Role: FOLLOWER
I20260811 07:32:02.736726 5523 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.738726 5523 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:02.741175 5694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.741364 5694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.741479 5686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: Bootstrap starting.
I20260811 07:32:02.742766 5612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.725963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.11.248.61:37627)
0811 07:32:02.726118 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.726124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.726402 (+ 278us) server_negotiation.cc:407] Connection header received
0811 07:32:02.727077 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.727084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.727159 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.727250 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.728514 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.730376 (+ 1862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.731670 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.732067 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.732172 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.736742 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.736748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.736752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.736799 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.739682 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.740615 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.740620 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.740622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.740772 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.741227 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.741231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.741233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.741566 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.741767 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.742424 (+ 657us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.742593 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 07:32:02.740624 5708 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:02.743535 5708 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260811 07:32:02.745935 5723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:02.746049 5723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:02.748136 12256 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:32:02.750048 5496 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5c428b2613f74c02b2cdc425763de8f5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53256
I20260811 07:32:02.750396 5496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:32:02.750524 5496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:02.752370 5496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.751066 5449 master_runner.cc:186] Error getting master registration for 127.11.248.60:34605: OK, instance_id { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" instance_seqno: 1786433522676054 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:32:02.755427 5577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c428b2613f74c02b2cdc425763de8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6c86dabf41d74c978b03094b42a58f78"
I20260811 07:32:02.755621 5449 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:32:02.755797 5577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:02.758163 5577 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c428b2613f74c02b2cdc425763de8f5 in term 1.
I20260811 07:32:02.758981 5469 leader_election.cc:302] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c428b2613f74c02b2cdc425763de8f5, 6c86dabf41d74c978b03094b42a58f78; no voters:
I20260811 07:32:02.759625 5496 leader_election.cc:288] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6c86dabf41d74c978b03094b42a58f78 (127.11.248.61:37627), e8f3fa8b2854479d9e56f88844384eb2 (127.11.248.60:34605)
I20260811 07:32:02.759848 5726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.760200 5726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.760353 5726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:02.760664 5726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [term 1 LEADER]: Becoming Leader. State: Replica: 5c428b2613f74c02b2cdc425763de8f5, State: Running, Role: LEADER
I20260811 07:32:02.761289 5726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.731932 5530 master_runner.cc:186] Error getting master registration for 127.11.248.62:39061: OK, instance_id { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" instance_seqno: 1786433522162187 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:32:02.763612 5530 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:32:02.763955 5686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:02.764212 5726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c428b2613f74c02b2cdc425763de8f5. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.765739 5686 log.cc:824] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:02.765985 5726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:02.769945 5686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: No bootstrap required, opened a new log
I20260811 07:32:02.779366 5735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:02.779304 5686 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.780632 5686 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f3fa8b2854479d9e56f88844384eb2, State: Initialized, Role: FOLLOWER
I20260811 07:32:02.783391 5686 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } }
I20260811 07:32:02.786383 5689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.765307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48844 (local address 127.11.248.60:34605)
0811 07:32:02.765432 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.765437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.767192 (+ 1755us) server_negotiation.cc:407] Connection header received
0811 07:32:02.767414 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.767418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.767472 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.767528 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.770230 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.771047 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.774755 (+ 3708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.775150 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.775242 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.778263 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.778267 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.778271 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.778329 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.780237 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.781982 (+ 1745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.781986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.781989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.782128 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.782998 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.783002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.783004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.783265 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.783397 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.786036 (+ 2639us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.786202 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:32:02.787392 5735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:02.788940 5612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.765190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50250 (local address 127.11.248.61:37627)
0811 07:32:02.765348 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.765354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.768872 (+ 3518us) server_negotiation.cc:407] Connection header received
0811 07:32:02.769127 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.769131 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.769189 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.769249 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.772641 (+ 3392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.773506 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.775942 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.776321 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.776412 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.782544 (+ 6132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.782549 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.782552 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.782589 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.784860 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.785694 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.785700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.785702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.785828 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.787446 (+ 1618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.787451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.787453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.787725 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.788038 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.788554 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.788702 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:32:02.793242 5737 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.793620 5737 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.797271 5659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5c428b2613f74c02b2cdc425763de8f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8f3fa8b2854479d9e56f88844384eb2"
I20260811 07:32:02.797633 5659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:02.799757 5659 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c428b2613f74c02b2cdc425763de8f5 in term 1.
I20260811 07:32:02.801982 5686 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:02.806164 5527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:02.765737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53270 (local address 127.11.248.62:39061)
0811 07:32:02.765874 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.765880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.782596 (+ 16716us) server_negotiation.cc:407] Connection header received
0811 07:32:02.783685 (+ 1089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.783690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.783766 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.783828 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.790704 (+ 6876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.791549 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.798305 (+ 6756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:02.798688 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:02.798797 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:02.801596 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:02.801601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:02.801604 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:02.801643 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:02.803661 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.804308 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.804313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.804315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.804426 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:02.805053 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:02.805059 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:02.805063 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:02.805321 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:02.805446 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:02.805835 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 07:32:02.805981 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:32:02.812672 5659 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [term 1 FOLLOWER]: Refusing update from remote peer 5c428b2613f74c02b2cdc425763de8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:02.814500 5577 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [term 1 FOLLOWER]: Refusing update from remote peer 5c428b2613f74c02b2cdc425763de8f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:02.815290 5710 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:32:02.817677 5750 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:02.817905 5750 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:02.819975 5710 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:02.824523 5737 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c428b2613f74c02b2cdc425763de8f5. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.824698 5737 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.830247 5694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c428b2613f74c02b2cdc425763de8f5. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.830431 5694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.836122 5726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.836305 5726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:02.836427 5739 mvcc.cc:205] Tried to move back new op lower bound from 7317231709433233408 to 7317231709235900416. Current Snapshot: MvccSnapshot[applied={T|T < 7317231709433233408}]
I20260811 07:32:02.839835 5737 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.840014 5737 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.841795 5710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.842000 5710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:02.843811 5694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c428b2613f74c02b2cdc425763de8f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c428b2613f74c02b2cdc425763de8f5" member_type: VOTER last_known_addr { host: "127.11.248.62" port: 39061 } } peers { permanent_uuid: "6c86dabf41d74c978b03094b42a58f78" member_type: VOTER last_known_addr { host: "127.11.248.61" port: 37627 } } peers { permanent_uuid: "e8f3fa8b2854479d9e56f88844384eb2" member_type: VOTER last_known_addr { host: "127.11.248.60" port: 34605 } } }
I20260811 07:32:02.843989 5694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:02.846494 5735 catalog_manager.cc:1347] Generated new cluster ID: 384f7de5bcc443be916f0520289ea065
I20260811 07:32:02.846598 5735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:02.881333 5735 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:02.882809 5735 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:02.898703 5735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c428b2613f74c02b2cdc425763de8f5: Generated new TSK 0
I20260811 07:32:02.899696 5735 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:32:02.938776 5527 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.935650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.11.248.62:39061)
0811 07:32:02.935793 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.935799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.937352 (+ 1553us) server_negotiation.cc:407] Connection header received
0811 07:32:02.937635 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.937639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.937695 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.937768 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.938601 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53274: BlockingRecv error: recv got EOF from 127.0.0.1:53274 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 07:32:02.940968 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.936594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50258 (local address 127.11.248.61:37627)
0811 07:32:02.936716 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.936721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.939342 (+ 2621us) server_negotiation.cc:407] Connection header received
0811 07:32:02.939829 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.939833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.939892 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.939977 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.940730 (+ 753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50258: BlockingRecv error: recv got EOF from 127.0.0.1:50258 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 07:32:02.943075 5689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.941667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.11.248.60:34605)
0811 07:32:02.941799 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.941803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.942076 (+ 273us) server_negotiation.cc:407] Connection header received
0811 07:32:02.942250 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.942254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.942317 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.942371 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.942937 (+ 566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48860: BlockingRecv error: recv got EOF from 127.0.0.1:48860 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 07:32:02.950459 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.948554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50264 (local address 127.11.248.61:37627)
0811 07:32:02.948683 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.948689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.949304 (+ 615us) server_negotiation.cc:407] Connection header received
0811 07:32:02.949562 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.949566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.949651 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.949709 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.950332 (+ 623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50264: BlockingRecv error: recv got EOF from 127.0.0.1:50264 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 07:32:02.956581 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.954541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50280 (local address 127.11.248.61:37627)
0811 07:32:02.954666 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.954670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.955394 (+ 724us) server_negotiation.cc:407] Connection header received
0811 07:32:02.955693 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.955697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.955754 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.955809 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.956451 (+ 642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50280: BlockingRecv error: recv got EOF from 127.0.0.1:50280 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 07:32:02.963649 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.961664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50284 (local address 127.11.248.61:37627)
0811 07:32:02.961805 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.961810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.962520 (+ 710us) server_negotiation.cc:407] Connection header received
0811 07:32:02.962746 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.962750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.962815 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.962875 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.963515 (+ 640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50284: BlockingRecv error: recv got EOF from 127.0.0.1:50284 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 07:32:02.972561 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.970456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50300 (local address 127.11.248.61:37627)
0811 07:32:02.970631 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.970636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.971341 (+ 705us) server_negotiation.cc:407] Connection header received
0811 07:32:02.971583 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.971588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.971656 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.971716 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.972434 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50300: BlockingRecv error: recv got EOF from 127.0.0.1:50300 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260811 07:32:02.985460 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:02.983297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.11.248.61:37627)
0811 07:32:02.983450 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:02.983456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:02.984168 (+ 712us) server_negotiation.cc:407] Connection header received
0811 07:32:02.984434 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:02.984439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:02.984504 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:02.984567 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:02.985329 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50304: BlockingRecv error: recv got EOF from 127.0.0.1:50304 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 07:32:03.005975 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:03.004468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50310 (local address 127.11.248.61:37627)
0811 07:32:03.004653 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:03.004661 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:03.004857 (+ 196us) server_negotiation.cc:407] Connection header received
0811 07:32:03.005036 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:03.005038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:03.005092 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:03.005172 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:03.005825 (+ 653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50310: BlockingRecv error: recv got EOF from 127.0.0.1:50310 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 07:32:03.042176 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:03.040595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50314 (local address 127.11.248.61:37627)
0811 07:32:03.040796 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:03.040801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:03.041070 (+ 269us) server_negotiation.cc:407] Connection header received
0811 07:32:03.041265 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:03.041271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:03.041329 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:03.041429 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:03.042024 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50314: BlockingRecv error: recv got EOF from 127.0.0.1:50314 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 07:32:03.110431 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:03.108835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50318 (local address 127.11.248.61:37627)
0811 07:32:03.109008 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:03.109013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:03.109167 (+ 154us) server_negotiation.cc:407] Connection header received
0811 07:32:03.109439 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:03.109450 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:03.109511 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:03.109626 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:03.110259 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50318: BlockingRecv error: recv got EOF from 127.0.0.1:50318 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 07:32:03.242902 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:03.241176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50334 (local address 127.11.248.61:37627)
0811 07:32:03.241367 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:03.241371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:03.241547 (+ 176us) server_negotiation.cc:407] Connection header received
0811 07:32:03.242048 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:03.242051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:03.242110 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:03.242197 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:03.242761 (+ 564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50334: BlockingRecv error: recv got EOF from 127.0.0.1:50334 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 07:32:03.503206 5612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:03.501674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50346 (local address 127.11.248.61:37627)
0811 07:32:03.501847 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:03.501851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:03.501954 (+ 103us) server_negotiation.cc:407] Connection header received
0811 07:32:03.502105 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:03.502108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:03.502158 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:03.502237 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:03.503074 (+ 837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50346: BlockingRecv error: recv got EOF from 127.0.0.1:50346 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:32:03.745273 5708 catalog_manager.cc:1259] Loaded cluster ID: 384f7de5bcc443be916f0520289ea065
I20260811 07:32:03.745378 5708 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: loading cluster ID for follower catalog manager: success
I20260811 07:32:03.747260 5708 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: acquiring CA information for follower catalog manager: success
I20260811 07:32:03.748610 5708 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6c86dabf41d74c978b03094b42a58f78: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:32:03.819545 5750 catalog_manager.cc:1259] Loaded cluster ID: 384f7de5bcc443be916f0520289ea065
I20260811 07:32:03.819675 5750 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: loading cluster ID for follower catalog manager: success
I20260811 07:32:03.821699 5750 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: acquiring CA information for follower catalog manager: success
I20260811 07:32:03.823182 5750 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e8f3fa8b2854479d9e56f88844384eb2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:32:04.022707 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:04.017827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50350 (local address 127.11.248.61:37627)
0811 07:32:04.018115 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:04.018119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:04.018137 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:04.018324 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:04.018327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:04.018476 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:04.018597 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:04.019000 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.019650 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.020767 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.021084 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.021198 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:04.021593 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:04.022125 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:04.022228 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:04.022338 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 07:32:04.022403 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":126,"threads_started":1}
I20260811 07:32:04.031637 5831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:04.026743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.11.248.60:34605)
0811 07:32:04.027074 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:04.027084 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:04.027143 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:32:04.027433 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:04.027436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:04.027572 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:04.027685 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:04.027975 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.028543 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.029812 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.030128 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.030230 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:04.030592 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:04.031150 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:04.031254 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:04.031351 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 07:32:04.031411 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":131,"threads_started":1}
I20260811 07:32:04.040206 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:04.035851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50366 (local address 127.11.248.61:37627)
0811 07:32:04.036012 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:04.036017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:04.036036 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:32:04.036107 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:04.036110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:04.036175 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:04.036261 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:04.036533 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.037393 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.038684 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.039070 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.039198 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:04.039527 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:04.039638 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:04.039690 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:04.039896 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 07:32:04.039993 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:32:04.040323 5831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:04.035548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.11.248.60:34605)
0811 07:32:04.036104 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:04.036107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:04.036120 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:32:04.036247 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:04.036288 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:04.036354 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:04.036445 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:04.036738 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.037579 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.038908 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.039312 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.039421 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:04.039717 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:04.039809 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:04.039880 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:04.040098 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 07:32:04.040169 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475}
I20260811 07:32:04.041715 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:04.035569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53288 (local address 127.11.248.62:39061)
0811 07:32:04.036299 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:04.036303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:04.036316 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:32:04.036421 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:04.036426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:04.036610 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:04.036942 (+ 332us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:04.037210 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.038061 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.039331 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:04.039742 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:04.039905 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:04.040262 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:04.040678 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:04.040789 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:04.041121 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 07:32:04.041585 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":113,"threads_started":1}
I20260811 07:32:04.046180 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 5449
I20260811 07:32:04.056911 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 5530
I20260811 07:32:04.066751 12256 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMRD5fR/build/debug/bin/kudu with pid 5614
2026-08-11T07:32:04Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3447 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6862 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (310806 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST